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I.   BACKGROUND  LZALING  TO  SXPERIMENTATICN 

A.   INTRODUCTION 

Tiiis  thesis  investigates  the  potential  application  of 
automatic  speech  recognition  (ASR)  technology  to  rriilitary 
imagery  interpretation  reporting.  It  stems  from  the 
author's  background  in  three  areas:  imagery  interpretation, 
Intelligence  Data  Handling  Systers  (IDES),  and  recent 
exposure  to  the  benefits  of  voice  data  entry  as  an 
alternative  modality  for  interacting  with  machines, 
especially  computers. 

The  need  for  the  thesis  arises  from  two  areas:  the  need 
to  evaluate  and  advance  current  ASR  technology  without  major 
redesign  of  systems;  and  the  need  for  faster,  reliable 
reporting  systems  for  the  intelligence  community.  Dr.  Wayne 
Lea  and  Dr.  Gary  Poock  called  for  the  evaluation  of  state- 
of-the-art  ASR  equipment,  specifically,  to  evaluate  input 
modalities,  e.g.  voice  versus  typing  [Ref s .  1  and  2],  The 
intelligence  community  is  continually  seeking  ways  to 
improve  performance  of  imagery  sensors  and  exploitation  and 
reporting  systems,  and  is  very  interested  in  ways  of 
reducing  costs  while  improving  the  quality  of  intelligence 
to  tactical  and  strategic  users. 

The  Soviet  Union  and  the  Warsaw  Pact  countries  are 
expected   to   employ  mass,  mobility,  and  surprise  tactics  in 
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any  future  European  attack  scenario  on  our  North  Atlantic 
Treaty  Organization  (NATO)  Allies.  The  speed  and  ran^'e  of 
rrodern  weaponry  leave  little  or  no  room  for  rristakes  in 
responding  to  crisis  situations.  Decision-making  in  minutes 
or  even  seconds  is  a  requirement  today,  and  is  likely  to  be 
more  critical  in  the  future  with  the  increased  use  of 
microelectronic  components  for  sensor  end  weapons  control, 
and  faster,  more  redundant,  survivable,  and  interoperable 
communications  facilities.  National  Command  Authorities, 
U.S.  Strategic  and  Tactical  Forces,  and  NATO  Theater  Forces 
must  have  accurate,  timely,  and  complete  indications  and 
warning  (I&W)  intelligence  of  the  enemy's  real  intentions 
and  capabilities.  Once  hostilities  begin,  with  today's 
warfighting  technology,  military  commanders  will  require 
near-real-t  iiie  (NET)  combat  informaticr  to  enable  them  to 
provide  effective  command  and  control  of  their  forces  to 
counter  the  enemy. 

Globally,  intelligence  must  be  available  for 
national  security  decisions  regarding  appropriate 
responses  to  international  terrorism  and  the  unwarranted 
intervention  of  foreign  powers  into  the  affairs  of 
other  nations.  Additionally,  intelligence  is 
required  for  long-ran^'S  planning  estimates  to  support  the 
acquisition  of  the  best  possible  -nix  of  forces  to 
meet  mission  requirements  in  support  of  basic  U.S. 
policy   and   objectives.     Finally,   intelligence    must 
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continually  support  Strategic  Nuclear  Command  and  Control 
forces  which  rust  alwa/s  be  at  a  sufficient  state  of 
readiness  tc  provide  nuclear  deterrence. 

The  following  basic  command  end  control  model  in  Figure 
1  was  adapted  from  the  work  of  Dr.  o^cel  Lawscn,  Technical 
Director,  Naval  Electronics  Systems  Command  [Rpf.  3].  it  is 
shown  here  to  illustrate  the  importance  cf  the  intelligence 
process  in  providing  support  to  command  and  control  of 
forces  in  war  and  peace.  Note  that  it  does  little  good  tc 
provide  better  sensors  without  also  improving  the  ability  to 
compare  the  information  derived  with  objectives  and 
historical  information  in  conjunction  with  intelligence 
analysis,  inherent  in  the  "compare"  process.  In  the 
reconnaissance  area,  imagery  exploitation  and  reporting 
would  fall  under  the  "compare"  function  cf  the  system,  and 
as  such  can  be  a  major  information  "bottleneck"  if  not 
capable  of  effectively  processing  the  sensor  output  to  meet 
the  informatior  needs  of  the  decision-raker. 
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Figure  1.   Basic  Command  and  Control  Model 
Regarding  the  central   importance   of   the   command   and 
control  process,  Dr.  Lawson  states, 


...the  central  problem  of  command  control  is  producing 
an  up-to-date  geographic  display  of  the  location  of 
"things."  Besides  purely  the  location  of  things  he  [the 
commander]  needs  to  know  what  [the]  things  ere,  what  is 
their  identity,  or  who  do  they  helcng  to  and  what  is 
their  status . 


Imagery  is  a  key  source  of  such  information,  end  is   thus   a 
major  contributor  to  the  command  and  control  process. 

Automated  imagery  interpretation  reporting  systems  have 
been  employed  for  strategic  and  theater  support  for  over  le 
years,  and  new  systems  which  include  exploitation  aids  are 
being   deployed    to    tactical    units   now.    They   have 
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significantly  reduced  the  tine  to  exploit  and  report  all 
types  of  imafe'ery  intelli^^ence .  However,  the  ran-machine 
interface  research  and  development  of  these  systems  must 
continue  to  meet  future  challen&*es  facing  the  intelligence 
corrrunity.  Significant  volures  of  irragery  intelligence  will 
be  available  from  NRT  digital  imagery  sensors  in  the  future, 
and  the  best  possible  rraa-machine  interface  must  be  sought 
to  effectively  exploit  ISW,  order  of  battle,  targeting,  and 
darrage  assessment  intelligence  available  frcm  imagery. 

Reporting  speed  and  accuracy,  manpower  reducti ons ,and 
increased  throughput  are  worthy  design  goals  for  new  or 
improved  imagery  exploitation  and  reportin^^  systems.  Voice 
data  entry  is  one  newly  evolving  technology  that  offers 
significant  potential  toward  these  goals.  Dr.  Vayce  Lea,  in 
the  introduction  to  his  book  Trends  in  Speech  Recognition, 
1980,  said: 


Speech  input  seems  to  offer  a  truly  natural  mode  of 
human-machine  communication  that,  if  attainable  in  a 
cost-effective  way,  would  be  unsurpassed  in  making 
computers  and  other  mechanical  devices  truly  cooperative 
servants  of  mankind,  rather  than  increasing  the  demands 
on  the  human  to  adapt  to  the  machine  [Ref .  4] . 


The  next  section  briefly  overviews  the  functions  of 
imagery  reporting  systems,  provides  some  examples  of 
systems  for  today  and  tomorrow,  and  mentions  some  specific 
requirements  which  lead  to  the  desirability  of  voice 
data   entry   for  imagery  intelligence  reporting. 
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B.   IMAGERY  INTERPRETATION  REPORTING  SYSTEMS 
1 .   Functions 

A  miliiary  imae;ery  interpretation  system  basically 
functions  to  provide  support  for  first,  second,  and  third 
phase  exploitation  of  rr.ul  ti-sensor  iiragery  in  response  to 
tasking  from  parent  or  outside  user  organizations.  These 
phases  represent  three  levels  of  depth  of  imagery  analysis 
in  accordance  with  Defense  Intelligence  Agency  (DIA) 
standard  reporting  procedures,  data  elements,  and 
requirements . 

First  and  second  phase  reports  represent  the  hulk  of 
the  vork,  and  are  called  Initial/Supplementary  Photo 
Interpretation  Reports  ( IPIRs/SUPIRs ) .  The  IPIR  rray  he 
thought  of  as  a  quick,  concise  response  to  time-sensitive 
requirements.  It  is  often  followed  by  the  SUPIR,  which 
represents  a  more  detailed  and  thorough  exploitation  effort. 
Third  phase  reporting  is  the  most  detailed,  and  includes 
special  analyses  and  reporting  of  selected  installations  of 
specific  interest  to  users  of  imagery  products. 

Such  reporting  standards  and  systems  grew  out  of 
requirements  forced  hy  large  increases  in  the  volume  of 
available  imagery  during  the  sixties.  During  the  sixties, 
the  volume  of  imagery  exceeded  the  exploitation  capabilities 
by  a  factor  of  five  to  ten  [Ref.  5].  This  drove  the 
development  cf  a  variety  of  imagery  exploitation  and 
reporting   systems   which   care   into    operation    in    the 
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seventies,  and  forced  standards  for  reporting  en  the  imagery 
intelligence  coirmunity  as  a  whole.  These  developments 
permitted  the  sharing;  of  imaf^ery  intelligence  via  magnetic 
tape  files  and  bulk  data  transfers  over  communications 
circuits.  It  also  facilitated  the  integration  of  imagery 
intelligence  into  more  general  data  bases,  and  enhanced  the 
'corporate  memory"  of  intelligence  units,  since  interpreters 
often  kept  installation  data  in  small  personal  files,  net 
easily  accessed  by  others.  With  better  data  bases, 
exploitation  was  enhanced  and  duplication  of  effort  was 
reduced  . 

Today,  imagery  exploitation  systems  are  located 
worldwide  in  support  of  U.S.  military  commanders.  The  focus 
now  is  on  providing  more  integrated  data  bases,  which  are 
optimally  dynamic,  complete,  and  timely.  ^ulti-source 
imagery  reports  may  be  telecommunicated  to  and  from  many  of 
the  sites,  and  distributed  tc  users  with  a  valid 
re<iuirement .  Integrated  data  bases  will  afford  producers 
and  users  with  more  resj-onsive,  coordinated  information  in 
time  of  need. 

Imagery  systems  range  from  national  level  to 
tactical  reconnaissance  squcdron  level  systems.  They  have 
become  increasingly  capable  of  supporting  many  tasks 
associated  with  exploitation  and  reporting:  responding  tc 
tasking  transmitted  over  telecommunications  networks; 
managing   interpretation   hardware,   software,  and  data  base 
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resources;  exploiting;  the  imae;ery  to  include  making 
[reasurements  on  the  iria^er/,  correlating^  inagery  with  rraps » 
ccmpcsing  reports,  editing  them,  and  ether  support 
functionsi  disseminating  reports?  and  automatic  screening 
end  updating  of  local  imagery  and  multi-source  date  bases. 
2 .   Examples  of  Imagery  Interpretation  Reporting  Systems 

The  DIA  uses  the  Automated  Imagery  Related 
Exploitation  System  (AIRES),  modeled  after  the  PACER  system 
used  by  the  Strategic  Air  Command's  544th  Aerospace 
Reconnaissance  Technical  Wing.  PACER  means  Program  Assisted 
Console  Evaluation  and  Review,  and  consists  of  a  dual 
Honeywell  6083  based  computer  system  and  UNIVAC  1652 
consoles  supporting  the  interpretation  process.  Both 
systems  support  a  wide  variety  of  analyst  functions. 

A  system  developed  and  installed  in  the  late 
seventies  for  theater  and  tactical  user  support  is  the 
Computer  Assisted  Tactical  Information  System  (CATIS).  This 
system  is  used  by  fixed-site,  imagery  exploitation  units  in 
the  Pacific  Air  Forces  (PACAE),  the  Tactical  Air  Command 
(TAC),  the  Jleet  Intelligence  Center  for  Europe  and  the 
Atlantic  (FICEURLANT) ,  the  United  States  Air  Forces  in 
Europe  (USAFE),  and  the  training  site  in  Air  Training 
Command  (ATC).  The  imagery  exploitation  support  provided  by 
CATIS  may  be  viewed  in  Figure  2. 

To  provide  highly  mobile  support,  the  Tactical 
Information    Processing    and    Interpretation,    Imagery 
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Interpretation  System  (TIPI  IIS)  was  developed,  and  is  being 
deployed  to  Air  Force,  Marine,  and  Amy  tactical 
reconnaissance  support  units  worldwide.  The  photo 
interpretation  console  of  the  TIPI  IIS  rray  be  viewed  in 
figure  3,  displaying  a  great  deal  of  modular,  ruggedized 
support  equipment  for  imagery  interpretation  reporting  and 
communications.  This  system  provides  motile  automation  at 
the  squadron  level,  not  previously  available.  For  example, 
an  interpreter  can  use  a  cursor  in  the  light  table  to  make 
rapid,  accurate  measurements  of  objects  such  as  bridges, 
runways,  and  storage  tanks  and  store  the  answer  on  an 
electronic  scratch  pad  for  later  insertion  into  a  report. 
Reports  are  filled  in  quickly,  using  a  f ill-in-the-blank 
online  report  composer.  They  may  then  be  edited  by  a 
supervisor,  and  distributed  over  secure  communications 
links . 

To  perform  side-looking  airborne  radar  (SLAR) 
exploitation  and  reporting  the  TIPI  Manual  Radar 
Reconnaissance  Sxploitation  System  (MARRIS)  was 
developed,  but  with  a  different  console  (Figure  4).  This 
system  provides  special  readout  of  rc'dar  imagery  that  may  be 
used  in  good  or  bad  weather,  and  is  useful  for  discovering 
enemy  force  movements  in  inclement  weather,  such  as  that 
found   in   Europe.    Unique   man-machine   systems   have  been 
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i.:ure-2.   CATIS  Ire^ETj    -xpl  c  i  te  ti  on  Suppcrt 
(Aca-ted  fror  CATIS  User's  r^anual,  1979) 
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?i.-^ure  3.   TIPI  Imager/  Interpretation  S/ste"  (IIS) 
(Courtesy  of  Texas  Instruiren  t  s  ,  Inc.) 
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provided  to  assist  in  providing  detection  of  changes  in  the 
landscape  or  order  of  tattle. 

New  NRT  digital  imagery  reconnaissance  sensors, 
such  as  f oward-looking  infrared  imagery  (FLIE),  Synthetic 
Aperature  Radar  vSAR),  or  other  types  of  imagery 
which  can  he  supported  by  sensors  on  tactical  aircraft 
will  result  in  increased  NRT  imagery.  Eiploitaticn 
systems  to  support  the  sensors  must  he  developed  to  provide 
the  additional  support  required.  The  Air  Force  has 
initiated  advanced  developmental  models  to  prepare  for 
such  a  requirement . 

One  system  is  the  Reconnaissance  Reporting 
Facility  developed  to  support  the  Quick  Strike 
Reconnaissance  concept  whereby  the  reporting  facility  would 
receive  NRT  hardcopy  and  softcopy  (digital)  imagery  from 
reconnaissance  aircraft  over  the  forward  edge  of  the  battle 
area.  When  advancing  enemy  forces  posed  themselves  as 
targets  of  opportunity,  imagery  reports  would  notify  the 
strike  center  to  order  nearby  airborne  loitering 
aircraft  to  destroy  the  target.  Figure  5,  top  and 
bottom,  gives  views  of  the  shelter  developed  to  test 
the  NRT  reporting  concept. 
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Figure  5.   QSR  Reccnnaissance  Reporting  Facility  (RRF) 
(Courtesy  of  Texas  lastrurr.ents.  Inc.) 
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The  RRF  contains  computers,  communications,  and  bcth 
hardcopy  and  softcopy  iragery  exploitation  and  reporting 
stations.  Used  during  exploitation  of  a  target-rich 
wartime  environment,  this  facility  would  pose  a 
challenging  work  environment  for  the  test  of  interpreters 
end  supervisors.  Efforts  to  optimize  the  man-computer 
interface  could  only  result  in  improved  responsiveness  and 
greater  system  capability. 

Another  system,  for  strategic  use,  is  the  Compass 
Preview  digital  imagery  exploitation  system  shown  in  Figure 
6.  For  the  first  time,  interpreters  will  be  able  to  view 
stereo  images  without  the  aid  of  a  light  table,  hcrdccpy 
imagery,  or  a  stereoscope.  The  interpreter  can  use  computer 
support  to  enhance  the  image  to  improve  its  interpretabil ity 
in  terms  of  scale,  contrast,  sharpness,  and  other  image 
qualities.  Simultaneously,  historical  data  base  information 
and  reporting  formats  are  available  for  reporting  what  is 
seen  on  the  image  and  correlated  with  other  data. 
Measurements  may  also  be  made  using  a  Joystick  and  cursor. 

The  imagery  systems  discussed  represent  a  large  leap 
forward  in  imagery  intelligence  since  the  late  sixties.  The 
results  from  current  systems  such  as  PACER  and  CATIS  are 
encouraging  with  3:1  and  12:1  increases  in  output  as 
compared  to  their  predecessors,  less  duplication  of  effort, 
increased  validity  of  reporting,  and  most  importantly, 
better  responsiveness  to  specific  user  ouestions. 
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Imagery  reporting  systems  are  quite 
sophisticated,  having  incorporated  not  only  state-of- 
the-art  exploitation  techniques,  tut  others  as 
well  from  computer,  communications,  and  other 
intelligence  disciplines.  Significant  skill  and 
training  are  required  to  operate  them  effectively. 
Interpreters  are  not  trained  typists,  and  thus  their  speed 
may  slow  the  reporting;  process.  Additionally,  they  mey 
nave  an  inherent  fear  of  wcrkin,^-  with  computers. 
Continuing  attention  must  be  given  to  improving  the 
rran-machine  interface  to  optimize  the  system  product: 
complete,  accurate,  and  timely  imagery  intelligence.  Though 
not  a  panacea,  voice  data  entry  may  "be  part  of  the  solution 
for  imprcving  the  imagery  interpretation  systems,  hy 
improving  man's  interface  with  the  machine,  and  making 
optimal  use  of  man's  skills  as  an  image  analyst. 
3.   Requirement  for  Voice  Data  Zntry 

During  the  author's  recent  assignment  at  the  Armed 
Forces  Air  Intelligence  Training  Center,  he  was  responsible 
for  managing  the  initial  development  of  the  TIPI  IIS 
Operator  and  Supervisor  Courses.  As  he  observed 
interpreters  training  en  the  prototype,  it  was  often 
apparent  that  they  were  deficient  in  typing  skills.  It  was 
painfully  obvious  that  the  multi-million  dollar  IIS  would 
not  produce  reports  any  faster  than  the  few  words-per-minute 
of  the  "hunt  and  peck"   typist.    Certainly,   with   practice 

26 


individuals  may  improve  their  typing  speed  and  accuracy  as 
they  adapt  to  a  systeir,  but  as  we  have  seen,  the  trend  is 
toward  faster  reporting,  and  somehow  the  problem  of  data 
entry  rust  be  attacked  or  critical  resources  will  be  wasted 
en  systems  limited  by  the  the  man-in-the-1 oop . 

One  simple  and  effective  way  may  be  to  conduct 
typing  classes  to  improve  interaction  with  the  computer.  In 
fact,  online  routines  for  teaching  better  typing  could  be 
developed  to  improve  the  interpreters'  skills  between 
missions.  Another  way  may  be  to  use  voice  data  entry,  which 
offers  a  great  potential  beyond  even  the  fastest  typists  for 
data  entry,  should  be  easier  and  faster  to  train,  and  could 
be  used  in  conjunction  with  typing,  function  keys,  or  a 
variety  of  other  input  modalities. 

C.   AUTCr^ATIC  SPSICH  RECOGNITION 
1 .   Overview 

Automatic  Speech  Recognition  (ASR)  is  no  longer  a 
dream  of  the  future,  but  a  technology  being  applied  around 
the  world  by  people  who  use  machines,  allowing  effective 
rrachine  control  and  data  entry  into  computers.  ASR  is  not 
without  problems  or  limitations  however,  and  must  be 
carefully  examined  before  trying  to  apply  it.  Human  factors 
must  be  studied  and  tailored  to  the  application  to  allow  ASR 
to  have  the  appropriate  impact  it  affords.  Failure  to 
attend   to   operator   considerations   such    as   microphone 
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rrounting,  recognition  accuracy,  error  correction,  response 
time  and  delay,  feedback  and  prompting,  stability  of 
reference  data,  end  training  procedures  can  have 
catastrophic  effects  en  system  performance  for  both  the 
voice  system  and  the  system  it  aids  [Ref.  7]. 

The  ultimate  goal  for  speech  recognition 
science  is  to  develop  "speech  understanding  systems" 
which  give  the  appropriate  response  to  the  user's 
request,  and  do  not  just  recognize  tne  elements  of  speech  or 
¥ords  and  phrases  [Bef.  6].  Admittedly,  the  technology  is 
not  that  far  along,  but  many  applications  dc  not  need  or 
cannot  afford  the  ideal  speech  system.  The  question  that 
must  be  asked  now  is  "what  applications  can  be 
accomplished  in  a  more  cost-effective  manner  witn  voice 
recognition  systems  that  are  available  now  or  will  be 
available  within  the  next  few  years?" 

Speech  scientists  have  been  working  on  AS?  for  about 
28  years.  Commercially  available  speech  recognizers  became 
available  in  1972  with  Scope  Electronics,  Inc.  and  Threshold 
Technology  Inc.  delivering  quality  systems  which  achieved 
significant  results  under  a  variety  of  conditions.  In 
general,  recognition  accuracy  scores  from  99.0%  to  99.9% 
accuracy  have  been  achieved  in  laboratory  conditions  of  no 
noise,  adequate  talker  training,  and  consistent  talking 
habits,  iield  testing,  ncwever  has  usually  achieved  results 
in   the   neighborhood  of  97%  recognition  accuracy,  generally 
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as  a  result  cf  high  background  ncises  cr  speaking  tc  the 
system  in  a  manner  different  than  the  way  the  system  was 
trained  initially. 


All    ASR   systems 


'all    into    either 


of 


two 


categories:  continuous  (connected)  or  isolated  (discrete) 
speech  systems  [Ref.  9].  Continuous  speech  systems  work  en 
the  extraction  of  information  from  strings  of  words 
that  may  he  run  together  in  natural  speech  in  the  form  of 
strings  of  digits,  phrases,  or  sentences.  Is olated-word 
recognizers  require  that  a  short  minimum-duration  pause 
he  inserted  between  digits,  words  or  phrases  which  must  be 
spoken  within  a  given  period  of  time,  e.g.  two  seconds. 

These  isolated-word  recognizers  are  more  prevalent 
today  as  they  are  less  expensive,  more  accurate,  work  in 
real-time,  ana  are  more  readily  available.  Continuous 
speech  systems,  however,  may  be  available  within  the  next 
few  years  offering  250  word  vocabularies  and  recognition 
in  real-time  at  a  reasonable  price.  Continuous  speech 
systems,  in  the  upper  end  of  the  cost  spectrum,  are 
approximately  $li20,000.  High  quality  isolated-word  speech 
recognizers  normally  cost  in  the  tens  of  thousands  of 
dollars  today?  however,  a  few  companies  are  also  introducing 
systems  on  the  market  for  a  few  thousand  dollars  that 
can  recognize  vocabularies  of  about  250  words  with 
recognition  accuracies  of  9'7%  or  better,  according  tc 
Dr.Poock,   who   intends   to   compare  such  systems  at  NFS  for 
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command  and  control  applications.  At  the  tcttom  end 
of  the  cost  spectrum,  hobby  systems  are  currently  available 
for  a  few  hundred  dollars. 

Dr.  Lea,  well  recognized  for  his  work  in  speecn  science 
at  the  University  of  Southern  California  and  the  Speech 
Communication  Research  Laboratory  said  this  about  the  future 
of  speech  recognition  technology: 
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2.   Value  of  Speech  Recognition  Systems 

Speech  input  to  machines  can  be  of  significant 
value,  but  under  what  conditions  or  situations?  This 
section  discusses  some  of  the  advantages  and 
disadvantages  of  speech  input  described  by  Dr.   Lea. 


Speech  systems  offer  the  potential  to  capitalize 
on  the  best  of  man's  communicative  abilities,  give  him 
compatibility  with  unusual  circumstances,  and  help  him  gain 
additional  mobility  and  freedom  in  some  situations  [Ref. 
11].  Speech  is  said  to  be  the  human's  most  natural 
communication  modality.  It  is  familiar,  convenient,  and  can 
be  used  spontaneously  because  the  individual  uses  it  often 
in  all  types  of  situations.  Though  performance  with  voice 
ir&y  degrade  under  situations  of  stress,  it  may  not  degrade 
as  much  as  a  less  learned,  less  frei^uently  used  skill. 
Since  voice  is  familiar  to  the  user,  it  is  less  difficult  to 
train  him  to  use  the  system.  Additionally,  voice  is  the 
human's  highest-capacity  output  channel,  and  permits 
simultaneous  communications  with  humans  and  machines.  For 
example,  a  speaker  in  a  large  auditorium  or  a  command  center 
can  display  the  next  visual  on  a  large  screen  display  by 
saying  some  key  phrase  or  word  which  has  meaning  to  both 
listener  and  display  system.  To  illustrate,  when  Dr.  Pocck 
recently  briefed  a  group  of  senior  naval  officers  in  the 
Pacific,  he  used  such  key  phrases  as  "Good  Morning 
Admiral..."  to  begin  his  briefing,  and  "here  you  see  the 
(pause)  SKIPS  ..."  to  convey  briefing  information  and  tell 
the  command  and  control  graphics  display  system  to  present 
the  next  graphic  in  his  presentation  on  the  subject  of  Voice 
Input    for    Command   and    Control.    This   is   just   one 
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illustration  of  the  creative  ways  man  can  use  voice  input  to 
his  advantage. 

Navy  feasibility  studies  sponsored  "by  Naval 
Ilectronics  Systerrs  Comrr.and,  and  conducted  by  Dr.  Poock, 
eiarrined  the  potential  for  voice  data  entry  for  command, 
control,  communications,  and  intelligence.  Two  voice 
recce;nition  systems  were  installed  in  late  1980  at  Fleet 
Headquarters,  Commander-in-Chief  of  the  Pacific  (CINCPAC)  in 
Hawaii  to  examine  the  benefits  and  limitations  of  voice 
input  for  operation  of  the  Worldwide  Military  Command  and 
Control  Time-Sharin^  System  (WWMCCS  TS3)  and  the  nearby 
Ocean  Surveillance  Intelligence  System  (OSIS).  One 
advantage  of  many  of  the  new  voice  terminals  is  that  they 
are  stand-alone,  intelligent  terminals  with  standard 
ccmmunicat icns  interfaces  and  character  sets  that  can  be 
interfaced  rapidly  with  computers  possessing  those  same 
generic  interfaces.  Voice  units  may  be  moved  around  easily 
and  installed  as  simply  as  most  other  modern  RS-232  plug- 
compatihle  terminals.  Voice  ray  also  be  used  remotely  as 
much  as  2000  feet  from  the  main  computer,  free  from  any 
panel  space,  displays,  or  complex  apparatus. 

The  advantages  of  voice  input  fcr 
complementing  the  communicative  abilities  of  man  are 
offset  somewhat  today  since  a  user  cannot  speak  totally 
naturally,  but  must  insert  pauses  in  between  utterances,  and 
must  use  utterances  within  the   constraints   of   the    voice 
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system's  stored  vocabulary.  This  requires  the  user  tc 
be  very  familiar  with  the  vocabulary  in  use,  not 
ualike  knowiag  the  letters  of  the  alphabet. 

Speech  input  for  machines  is  also  of  value  in 
helping  man  cope  with  unusual  circumstances.  For  example, 
it  can  be  used  in  complete  darkness,  around  obstacles,  by 
the  blind  and  other  handicapped  individuals,  is  unaffected 
by  weii^htlessness ,  and  only  slightly  affected  by  high 
acceleration  and  mechanical  constraints.  On  the  negative 
side,  it  is  often  sensitive  to  dialect,  and  also  susceptible 
to  background  noise  and  distortions.  Additionally,  a 
microphone  must  either  be  worn  or  held  in  close  proximity  to 
the  speaker.  And  finally,  a  display  or  synthesized  voice 
feedback  may  be  necessary  for  tasks  requiring  data  entry 
validation. 

The  mobility  possible  with  vcice  input  is  one  of  its 
greatest  attributes.  It  enables  operation  of  devices  from  a 
distance  and  from  various  orientations,  permits  simultaneous 
use  of  hands  and  eyes  for  other  tasks,  and  can  even  permit 
the  telephone  to  be  used  as  a  computer  terminal.  Some 
degree  of  privacy  is  lost,  although  users  often  operate  in 
the  laboratory  at  NPS  inconspicuously  running  graphics 
displays  and  other  command  and  control  applications  without 
bothering  other  nearby  terminal  operators. 

The  key  questions  to  keep  in  mind  when  considering 
the  value  of  speech  input  are:  "is  there  an  application  that 
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cciild  te  doce  more  ccst-eff ect ively  usin^  vcice  as  a  single 
or  adiitional  input  modali ty? . . .and ,  "  Is  the  current 
technolcfiiy  adequate  to  provide  tiie  quality,  naturalness,  and 
speed  that  the  application  of  interest  re?iuires?"  A  brief 
lock  at  the  military's  efforts  in  voice  technology  may  help 
the  reader  to  further  assess  the  value  of  speech  technology 
for  his  ovn  application. 

3 .   Military  Researcn  and  Applications 

Research  supported  by  the  Advanced  Research  Projects 
Ai^ency  sZARFA),  which  funds  leading-edge  technology,  was  a 
prirre  ingredient  contributing  to  the  development  of  voice 
technology.  However,  a  large  number  of  military  projects, 
such  as  the  ARPA  Speech  Understanding  Research,  rret  with 
limited  success  as  a  great  deal  of  work  in  acoustic- 
phonetics,  speech  perception,  linguistics,  and 
psychcaccust ic  equipment  is  still  necessary  to  provide  the 
foundation  for  ASR  to  approach  hurran  performance  [Ref  12]  . 

Most  of  the  research  in  the  military  has  turned  to 
taking  off-the-shelf  isolated-word  recognizers  and  adapting 
therr;  to  particular  applications.  Recognition  studies  in  the 
military  have  been  done  for  applications  in  aircraft 
cockpits,  tactical  field  data  entry,  military  training 
systems,  cartography,  command  and  control  of  networks, 
wargames  and  graphics,  keyword  spotting  of  communications 
channels,  emergency  action  message  composition,  and  imagery 
interpretation  tasks  such  as  mensuration  and  reporting.   The 
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applications  most  clcsely  related  tc  this  thesis  are  the 
cartography,  command  and  control  of  displays,  and  imagery 
interpretation  reporting. 

A  significant  arrcunt  of  research  was  performed  for 
the  Defense  Mapping  Agency(D^'A)  by  contractors  under  the 
program  management  of  the  Air  i'crce's  Rome  Air  Development 
Center(RADC ) .  The  Defense  flapping  Agency  Aerospace  Center 
(DMAAC)  and  the  Defense  Mapping  Agency  Aerospace  and 
Eydrographic  Center  (DMAEC)  produce  large  volumes  of 
cartographic  products  for  the  military  and  other  users. 
Research  has  been  performed  for  such  applications  as  voice 
data  entry  for  the  processing  of  Digital  Landmass  System 
(DIMS)  data,  preparation  of  Flight  Information  Publications 
(FLIPS)  data,  and  ocean-depth  neasurements  for  digitized 
cartographic  applications.  In  these  applications  analysts 
were  performing  tasks  in  an  "eyes  husy,  hands  "busy 
environment,"  sometimes  with  stereo  optics  and  or  other 
special  devices.  Voice  was  shown  experimentally  to  he 
faster,  easier,  and  a  less  fatiguing  mode  of  data  entry  than 
the  more  conventional  modes  used  [Refs.  13,  14,  and  15]. 
User  acceptance  and  system  support  can  he  significant 
problems,  as  explained  by  DMAAC  officials  to  the  author 
during  a  recent  visit  to  tneir  facilities. 

The  NPS  is  currently  performing  voice  data  entry 
research  in  the  area  of  command  and  control  applications. 
In   a   study   by   Focck,   twenty-four   command   and   control 
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students  operated  the  AEPA  network  or  AEPANZT,  a  distributed 
netVkcrk  cf  computers  in  the  U.S.  and  Europe,  using  voice  and 
typing  as  a  comparison  between  the  two  rrodes  [Ref.  15]. 
Voice  was  sisrnif  icantly  faster  and  more  accurate  for 
enterin,§  commands  into  the  system.  Additionally,  students 
vere  given  an  secondary  transcription  task  to  perform  while 
operating  the  AF.PANIT.  The  voice  mode  permitted 
substantially  more  data  to  be  transcribed  than  the  typing 
mode.  On  the  other  hand,  McSorley  recently  demonstrated 
that  voice  was  no  faster  than  typing  for  entering  commands 
into  a  wargame.  This  was  due  in  part  to  the  peer  editing 
features  of  the  game,  but  demonstrates  that  voice  is  not  for 
everything  [Hef .  17] . 

In  the  area  cf  imagery  interpretation,  interest  in 
voice  data  entry  is  growing.  RADC  recently  completed  a 
study  which  evaluated  a  voice  recognition  system  known  as 
"Talk  and  Type,"  built  by  Threshold  Technology  Inc.,  to 
study  the  application  of  voice  data  entry  to  the  problem  of 
imagery  interpretation  and  intelligence  report  generation 
[Ref.  18].  The  innovation  by  Threshold  required  the  user  to 
type  the  first  letter  of  the  word  to  be  recognized.  In  this 
manner  the  voice  system  restricted  the  size  of  the 
vocabulary  to  be  searched,  thereby  increasing  recognition 
accuracy.  Four  varied  tests  were  performed  looking  at  small 
and  large  vocabularies,  and  especially  tasks  where  the 
subject  was  describing  scenes  the  way  an   interpreter   might 
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describe  a  bridge  or  a  ruLway.  The  results  showed  the  Talk 
and  Type  systeT  tc  be  superior  ever  typin,^:  for  unskilled 
typists. 

Soon  the  new  ground  station  for  the  Tactical 
Reconnaissance-l  . TR-1)  aircraft  is  expected  tc  be  built  tc 
provide  exploitation  and  reporting  support  for  the  sensors 
aboard  the  U-2  derivative  aircraft  which  is  expected  to 
provide  NRT  reconnaissance  support  to  theater  forces. 
According  to  the  program  manager,  voice  data  entry  is  a 
serious  consideration  for  inclusion  into  the  program. 

D.   SUMMARY 

The  purpose  of  this  thesis  is  to  investigate  the 
potential  application  of  ASR  technology  to  military  imagery 
interpretation.  The  research  responds  to  the  need  for 
rapid,  concise,  valid  information  for  command  and  control 
of  forces  in  peace  and  war.  The  functions  of  the  imagery 
reporting  systems  include  support  for  a  variety  of 
tasks,  especially  composing  reports.  The  specific  focus 
cf  the  thesis  is  to  examine  the  feasibility  of 
writing  order  of  battle  reports  using  a  large  voice 
vocabulary  of  255  words  of  USSR/Warsaw  Pact  military 
equipment  names,  editing  commands,  and  alphanumerics . 

Several  examples  of  modern  operational  and 
developmental  imasery  exploitation  and  reporting  systems 
were  briefly  discussed  which  represent   potential   systems 
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for  application  of  voice  technology.  Incorporation  of  ASH 
technology  could  resv.lt  in  improved  capabilities  in  terms 
of  speed,  accuracy,  and  completeness  of  imagery 
reporting.  ASR  technology  rrakes  optimal  use  of  the  fact 
that  speech  is  man's  most  natural  input  modality, 
while  the  lirrited  speeds  of  interpreters  typing  may  not 
optimize  advanced  reporting  system  capabilities. 

The  advantages  and  disadvantages  of  speech  were 
presented.  Some  of  the  value  of  speech  input  awaits 
technological  breakthroughs  and  may  not  be  realized  in  this 
decade.  The  military  is  not  waiting  however,  and  seems 
unwilling  to  pay  for  ail  the  basic  research  to  push 
continuous  speech  systems.  Instead,  the  military  is  hard  at 
work  witn  applications  efforts  with  limited-vocabulary, 
isolated-word,  speaker-dependent  voice  recognition  systems, 
proven  to  be  reliable  and  accurate  for  the  right 
applications,  while  monitoring  and  sometimes  supporting  work 
by  private  contractors,  hopefully  leading  to  practical 
continuous  speech  systems. 

The  objective  of  this  thesis  is  to  support  military 
applications  research  efforts  aimed  at  comparing  input 
modalities,  and  afford  the  intelligence  community  an 
independent  data  point  regarding  the  overall  evaluation 
of  ASR.  This  research  began  independent  of  the  related 
P.ADC  research,  and  thus  serves  to  underscore  the 
appropriateness  of  voice  data  entry  support  to  the  task. 
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II.   LESCRIPTION  01    THE  2XPERI^■ENT 

A.   CEJECTIVES  AM  CCNSTRAIMS 

The  objective  cf  this  experiment  was  to  deternrine  if 
state-of-the-art  voice  lata  entry  equipment  was  feasible  for 
reporting  imagery-aerived  order  of  battle  (CB)  intelligence 
using  an  interactive  computer  system.  The  experiment  was 
designed  to  determine  if  txiere  was  any  significant 
difference  in  speed,  accuracy,  efficiency,  and  subject 
attitudes  regarding  manual  keyboard  and  voice  data  entry  for 
this  task.  A  large  unclassified  vocabulary  cf  255  words 
containing  alphanumerics ,  commands,  and  representative 
USSR/Warsaw  Pact  ecuipment  names  was  selected  for  the 
reporting  scenario  (see  Appendix  A).  Based  on  recent 
research,  voice  data  entry  was  expected  to  be  faster,  more 
accurate,  and  preferred  by  subjects  over  manual  keyboard 
data  entry  [Ref .  18] . 

Accomplishment  of  this  objective  was  constrained  within 
the  research  facilities  of  the  Naval  Postgraduate  School 
(NPS).  In  the  interest  cf  time  and  money,  the  r>rccess  of 
reporting  was  simulated  to  the  maximum  degree  possible 
within  the  constraints  of  available  subjects  and  laboratory 
facilities.  This  simulation,  though  net  ideal,  afforded  an 
effective,  economical  tool  to  accomplish  this  objective. 
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E.   SUBJECTS 

Twenty  subjects  participated  en  a  volunteer  tasis. 
The  group  was  composed  of  13  military  officers,  and 
two  civilians.  The  military  officers,  representing  the 
Army,  Navy,  Air  force,  and  Marines  included  17  males  and  1 
female;  tneir  grades  ranged  from  Lieutenant  to  Commander 
and  from  Captain  to  Lieutenant  Colonel.  The  civilians 
included  an  employee  of  the  National  Security  Afrency  and 
a  professor  from  the  NPS  Operations  Research  Department. 
The  sutjects'  asies  ranged  from  28  to  45,  with  an  average  age 
of  33. 

Seventeen  of  the  subjects  were  enrolled  in  the  Command, 
Control,  and  Communications  (C3)  Curricula  at  NPS,  while  the 
other  two  students  were  from  the  Intelligence  and  Computer 
Science  curriculas.  The  background  of  the  subjects  were 
quite  varied:  special  warfare;  ground  combat;  communications 
maintenance  and  staff;  logistics  staff;  automatic  data 
processing;  training;  intelligence;  C3  research;  language 
analysis;  electronic  warfare;  Joint  Chiefs  of  Staff;  field 
artillery;  destroyer  group  staff;  combat  development;  C3 
training  and  operations;  and  tactical  C3  flight  operations. 

Nineteen  of  the  subjects  had  experience  with  interactive 
coTiputer  systems  at  NPS.  Eighteen  of  the  subjects  were 
experienced  in  use  of  the  ARPANET,  a  network  of  computer 
systems  available  fcr  use  by  the  C3  Curricula  and  other 
researchers   at   NPS.    The   two   subjects   without   ARPANET 
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experience  were  trained  to  tne  level  necessary  to 
participate  in  the  experiment  with  their  contemporaries, 
since  a  computer  on  the  AH?A.\ET  v^as  chosen  as  tne  host  for 
the  experiment . 

The  subjects  v*ere,  as  a  whole,  familiar  with  speech 
recognition  as  many  had  either  seen,  used,  or  even  studied 
automatic  speech  recognition.  Eighteen  subjects  had  seen  a 
voice  recognition  system  demonstrated;  12  subjects  had  used 
voice,  primarily  as  subjects  in  one  other  experiment;  and  11 
had  studied  voice  for  a  term  paper,  thesis,  or  work  at  their 
previous  duty  station. 

C.   EQUIPhSNT 

1 .   Voice  Recognition  System 

A  Threshold  Technology  Inc.  ^lodel  T6ee  voice 
recognition  system  was  used  to  represent  commercially 
available,  state-of-the-art  equipment.  The  T600  is  a 
speaker-dependent,  isolated-word  recognizer  which 
automatically  recognizes  spoken  words  or  phrases.  These 
words  or  phrases  are  called  utterances  and  must  be  in  a 
range  of  0.1-2.0  seconds  in  duration  and  must  be  separated 
by  very  short  pauses  of  0.1  second  or  mere  [Ref.  19] . 

The  terminal  consists  of  a  threshold  analog  speech 
preprocessor,  an  LSI-11  microcomputer  and  a  digital  RS-232 
input/output  interface,  an  Ann  Arbor  large  character 
display  and  operator  console,  an  operator  console/microphone 
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prearrplif  ier ,  and  a  tape  cartridge  unit.  The  speech 
preprocessor,  rr.  icrocorr.puter ,  and  interfaciag  elerrents  are 
contained  in  the  ^lain  terminal  unit  which  was  table  mounted. 
The  remaining  components,  the  display  console,  and  tape  were 
also  table  mounted  and  located  with  the  main  terminal  (see 
Figure  7).  A  Shure  S^'-10  noise-cancelling  microphone  with 
headset  was  used  for  the  voice  input  to  the  preamplifier. 

The  T600  combines  analog  and  digital  signal 
processing  technology  to  perform  the  recognition  function. 
The  energy  from  the  spoken  utterance  is  passed  through  19 
bandpass  filters  spanning  the  speech  spectrum.  The  presence 
or  absence  of  each  of  32  acoustic  features  is  determined, 
and  the  appropriate  feature  information  is  extracted  by  a 
combination  of  analog  and  binary  logic.  The  features  are 
either  primary  features  or  phonetic-event  features.  Primary 
features  describe  the  energy  spectrum  by  measuring  local 
maxima  and  the  energy  rate-of-change  relative  to  the 
frequency  of  the  voice  signal.  Phonetic-event  features 
result  from  measurements  corresponding  to  pnoneme-like 
events:  vowels,  nasals  and  fricatives.  The  preprocessor 
also  must  determine  the  beginning  and  ending  of  each  word. 
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The  T600  hes  two  primary  nodes  of  operation: 
training  rrode,  and  recognition  rrcde.  In  the  training  rrode, 
the  Te22  extracts  a  titne-norma  li  zed  tenplate  for  each  given 
word.  Ihis  teriplate  consists  of  ti*o  arrays  referred  to  as 
ihe  most  significant  tit  v^iSBj  and  noa  eitremum  tit  (NEB). 
The  KSB  indicates  whether  a  particular  feature  has  occurred 
and  the  NEB  indicates  the  frequency  of  occurrence.  These 
arrays  comtine  to  forrr,  the  reference  array  (BAR)  .  When  the 
1600  is  in  recognition  mode,  the  preprocessor  functions  as 
tefore:  features  are  extracted,  digitized,  and  tine 
norrralized.  The  resultant  feature  array  (EAR)  is  correlated 
with  the  stored  RARs  in  the  current  active  vocatulary  and 
the  test  correlation  is  selected  as  the  recognized  word. 

As  previously  mentioned,  for  eech  utterance  32 
acoustic  features  represented  in  tinary  form  and  their  tire 
of  occurrence  are  fed  from  the  preprocessor  to  the 
rricrocomputer  short-tern  rremory.  The  pa  ttern-ratching 
algorithm  subsequently  compares  these  feature  occurrence 
patterns  to  the  stored  reference  patterns  for  the  various 
vocabulary  words  and  determine  the  "test  fit"  for  a  word 
decision.  The  FAR  of  a  test  word  requires  512  tits  of 
information  (32  features  mapped  into  16  time  segments}.  The 
RARs  include  1024  tits  per  word  teceuse  of  the  two  part 
arrays . 

When  the  Te00  recognizes  a  word  in  its  vocatulary  it 
will   output   a   preprogrammed  string  of  up  to  16  characters 
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associated  with  the  spoken  wora.  These  output  strings  can 
be  modified  "by  the  user  at  any  time  via  his  ASCII  console, 
which  may  also  be  used  instead  of  voice  to  interact  with  the 
host  computer.  Also  associated  with  each  word  are  training 
prompts  which  are  strings  of  up  to  12  ASCII  characters 
displayed  on  the  CRT  terminal  to  notify  the  user  of  the  word 
to  be  trained.  The  T600  used  in  this  experiment  re<iuired  12) 
training  utterances  per  word. 

Two  types  of  errors  can  occur  with  the  T600: 
misrecognition  and  rejection.  Misrecognition  errors  are 
those  where  an  output  string  is  selected  for  output  that 
does  not  match  the  utterance.  When  the  system  rejects  the 
utterance  as  not  part  of  the  vocabulary  it  signals  the 
operator  with  a  "beep."  These  two  cases  assume  the  word  was 
in  the  vocabulary  and  properly  trained.  Other  errors  are 
called  operator  errors  and  arise  from  mispronunciation, 
using  words  not  in  the  vocabulary,  or  a  variety  of  other 
errors  such  as  speaking  too  fast  or  slow. 

The  T600  used  had  enougn  memory  modules  to  maintain 
an  active  working  vocabulary  of  256  utterances. 
Vocabularies  were  input  and  output  using  the  tape  cartridge 
unit.  The  system  reads  and  stores  prompt  and  output  strings 
and  reference  patterns  from  semiconductor  random  access 
memory  onto  rugged,  high-quality  magnetic  tapes  similar  to 
cassette  tape  cartridges.  A  complete  256  word  vocabulary 
may  be  recorded  or  loaded  in  a  few  minutes. 
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Two  recognition  nodes  are  available  on  the  Tei2'0 : 
unbuffered  and  buffered.  In  unbuffered  mcde,  the  T600  will 
send  any  output  imrrediately  to  the  host  corputer.  No 
internal  processing  is  performed  on  the  output  strings. 
Eowever,  the  buffered  mode  permits  up  to  126  utterance 
output  strings  to  be  sequentially  stored  in  a  T600  buffer 
for  subsei^uent  output  as  a  composite  block  of  characters. 
An  "erase  function"  may  be  used  to  delete  the  last 
utterance;  an  "interrupt"  function  sends  a  special  user- 
defined  string  to  the  host  and  deletes  the  remainder  of  the 
buffer  contents;  a  "cancel"  function  may  be  used  to  delete 
the  buffer  contents;  and  a  "transmit"  function  will  cause 
the  T600  to  send  the  buffer  contents  to  the  host.  The 
utterance  assigned  to  these  functions  rray  be  independent  of 
their  function  name. 
E.   Tachis toscope 

To  provide  a  simulation  of  the  light  table 
and  optics  portion  of  the  imagery  interpreter's  work 
environment,  the  G--1130  Harvard  Tachi  stoscope  was 
selected  from  the  man-macnine  laboratory  facilities, 
(see  Figure  6)  The  tachistoscope  is  an  instrument  that 
can  present  images  of  material  presented  en  cards  ar.d, 
as  modified  in  this  experiment,  a  CRT  display.  The  card 
images  may  be  presented  by  a  timer  or  changed  at  will  by  the 
subject   using  a   button  switch.   Lighting  may  be  regulated 
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end  rriul t i-imdges  overlayed.  The  three  primary  uses  of  the 
device  are  studies  on  learning,  perception,  and  attention 
[Ref  .  £0]  . 

However,  in  this  experiiT,ent  the  tachi  stoscope  was 
used  in  the  following  nianner.  Tne  viewport  seen  in  Figure  9 
simulates  the  optics  through  which  an  interpreter  must  ^T^t 
much  of  his/her  data.  The  4"  x  6"  cards  seen  through  it 
simulated  the  imagery  the  interpreter  was  tasked  to  analyze 
and  report.  The  CRT  presented  three  lines  of  data  (40 
characters  each)  providing  visual  feedback  for  voice  data 
entry.  (Note:  Rome  Air  Development  Center  has  developed  an 
eyepiece  for  a  Eausch  &  Lomb  stereoscope  that  displays  16 
characters  of  data  wnile  viewing  the  optics!  thus  the  author 
assumed  that  more  data  could  be  displayed  in  the  next  few 
years  to  support  such  visual  feedback,  if  required.) 

The  tachistoscope  viewport  permitted  the  viewing  of 
the  scenario  cards  and  the  Ann  Arbor  CRT.  The  card  image 
was  centered  above  the  three  bottom  lines  of  the  large- 
character  CRT.  The  CRT  displayed  the  responses  of  the  Tg02 
to  the  subject's  utterances,  thereby  providing  visual 
feedback  to  him/her  performing  the  task. 
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3.   Scenario  Cards  and  Vccatulary 

The  cards  for  the  reportin=r  scenario  vere  used  to 
simlate  frares  of  irragery.  Because  no  imagery  interpreters 
were  available  in  lar^e  numbers  for  the  experiment  at  NFS, 
the  author  created  the  cards  with  a  "**"  to  represent  the 
equipment  location  and  annotated  the  "**"  with  the  number 
and  description  of  the  e^iuipment  at  the  point.  All  subjects 
were  provided  with  the  same  information,  i.e.  they  were 
"perfect  imagery  interpreters"  and  any  experience  level  was 
held  constant. 

Figure  10  illustrates  the  format  of  two  sample  cards 
which  had  five  to  eight  objects  and  an  installation  number. 
Each  card  was  divided  into  four  quadrants  to  simplify  and 
standardize  the  reporting  process  and  scoring. 

Thirty-six  cards  were  required  for  the  experirent. 
Their  content  was  governed  ^oy  four  criteria:  realism,  an 
even  mix  of  ground,  air,  and  naval  terms,  full  use  of  the 
USSR/Warsaw  Fact  vocabulary  selected  for  the  experiment,  and 
[raintaining  a  balance  in  number  of  characters  among  sets  of 
cards  to  be  used  in  experimental  trials.  The  cards  used  in 
the  experiment  are  shown  in  reduced  size  in  Appendix  3.  The 
larger,  actual  size  cards  seen  in  figure  12  were  produced 
using  large  print  on  a  Tektronix  4014  terminal  and  its 
associated  thermal  printer. 
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INSTALLATION  e298-T14217 

!  tt 

50  CONFIRflED  ASU-85  AIRBORNE  ASSAULT  GUNS 

27  CONFIRHED  ASU-57 ' AIRBORNE  ASSAULT  GUNS 
tt  ! 


tt   20  POSSIBLE  n-20  HEAUY  PIORTARS 

62  PROBABLE  122-nn  D-30  FIELD  HOUITZERS  tt 

I 
I 

48  CONFIRnED  240-nn  Bn-24  ROCKET  LAUNCHERS 

tt        I 

_«. — «._  • «.__«.«. 

INSTALLATION  0ig9-ui4197 

'     tt 
16  CONFIRHED  ni-4lH0UND  HELICOPTERS 

I 

11  CONFIRHED  ni-12-HOnER  HELICOPTERS 

tt   S   PROBABLE  ni-6_H00K  HELICOPTERS 

I  __________ ______^_^.^ 

I 

*  tt 
21  CONFIRMED  ni-10_HARKE  HELICOPTERS 


tt         1 

19  PROBABLE  ni-24.HIND  HELICOPTERS 

I 

I 

t 

' _______ 

Fi.:vTe    12.      ScP-ple^  Scere  ric  "cris 
(ectudl  size  =  ^"   X  t'    includiri;;^  border^ 


A  USSR/Warsaw  Pact  vocabulary  was  used  because  of 
available  unclassified  source  inforration  ia  lar^e  quantity 
[Ref s .  21,  22,  23, and  24].  A  full  vocabulary  cf  255  words 
was  used  containing  the  phonetic  alphabet,  numbers  0-25, 
administrative  alphanumerics ,  special  symbols  and  control 
characters,  and  sround,  air,  and  naval  forces  equipment 
vocabulary.  Appendix  A  contains  a  complete  listing  of  the 
vocabulary  by  nurrber,  training  prompt,  and  output  string. 

The   vocabulary   was   not   structured   in   terms   of 
recognition   sets.    Rather,  the  T600  operated  on  the  entire 
vocabulary  each  time  an  utterance  was  spoken. 
4.   Interactive  Computer  System:   APPANZT 

To  provide  an  interactive  text  editing  environment 
for  the  reporting  scenario,  the  facilities  of  the  ARPANET 
were  selected  because  of  their  reliability  and  also  to 
demonstrate  how  reporting  might  be  done  over  a  distributed 
network  of  computers,  rather  than  a  local  host  system.  The 
ARPANET,  now  managed  by  the  Eefense  Communications  Agency, 
was  used  by  16  cf  the  subjects  during  5  quarters  of  their  C3 
Curricula  prior  to  the  experiment. 

Two  host  computers  were  used:  Information  Sciences 
Institute  Systems  1  and  C  (ISIE  &  ISIC),  located  in  southern 
California.  The  experimental  text  editor  (XEL/,  phctoscript 
(PHCTO),  directory  linking  (TALK),  file  transfer  protocol 
(?TP),  and  file  archival  (ARCEIVZ)  were  the   major   programs 
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used  to  conduct  and  manege  the  experimental  date  and 
interactive  cor.puter  envi  ronrrent .  ISIC  was  the  primary 
system  used,  because  the  "system  load  level"  was  generally 
lower  thereby  offering  a  more  responsive  system.  The  load 
level  was  checked  during  experimentation  to  assure  a 
consistent  response  tim-e  was  available  to  ail  subjects. 
Beth  systems  were  supported  by  the  TCPS-c2  Operating  System, 
on  Eigital  Equipment  Corporation  (DEC)  f^odel  20  Computers. 

These  computers  were  linked  to  NFS  terminals 
equipped  with  phone  r.oders  or  acoustic  couplers  via 
the  ARPANET  distributed  communications  facilities. 
These  facilities  include  a  teritinal  interface  processor 
(TIP;  at  NFS  connecting  school  terminals  with  ISI  via 
the  ARPANET.  The  author  gained  access  to  the  network 
via  the  TIF  and  selecting  the  network  computer  to  be 
used.  The  ARPANET  providea  a  myriad  of  facilities 
supporting  the  administration  of  the  experiment.  Figure  11 
is  a  map  of  the  ARPANET  adapted  from  the  ARPANET  Information 
Brochure,  1979. 

CRT  terminals  and  the  T6Z'0  were  attached  to  the 
ARPANET  via  30£  bps  acoustic  couplers.  A  Lier-Siegler 
ADM  CRT  display  was  situated  near  the  tachistoscope  to 
provide  keyboard  entry  of  the  OB  data  obtained  from  the 
cards  via  the  viewport  (see  Eigure  12).   The  ADM  terminal  on 


55 


=^ 

^ 

£-• 

. — , 

,-j-i 

.^^ 

^ 

>. 

■-^ 

J> 

a, 

rH 

i— , 

'i; 

<A 

KH 

W 

OJ 

3 
1 

.^ 

E 

►- 

t-H 

XI 

_i 

in 

,      , 

< 

O 

X) 

Oj 

z 

UJ 

2 

>■ 
-1 

^^ 

a 

X. 

■0. 

w 

4 

■•-* 

0. 

i-TH 

UJ 

Ui 

(/) 

O 

'2 

Z 

IK 

^ 

< 

o 

» 

2 

o 

X 

«/>* 

(/> 

i-i 

►-  -~ 

a 

O  «'> 

«» 

z  z 

z 

,«o 

a 

c/»  — 

a 

Ui  ►- 

0. 

0«J 

X  ►- 

Ui 

iX 

< 
z 

1 

X 

3 

b»    — 

</t 

_j 

-J 

a 

s"' 

U4 

<3 

o< 

4 

Z</t 

Z 

CD 


0-H 

ce 

•a; 

1 — 1 

a.' 

<v, 

x: 

c 

■*-> 

•.-I 

tz. 

fD 

S-, 

•r-t 

0) 

> 

tH 

f- 

z; 

OJ 

r-^ 

*J 

^ 

5 

£ 

• 

o 

CvJ 

c; 

■t-i 


T2 

OJ 


tJ 


c7 


ihe  ARPANET  was  used  to  sirrulate  the  text  eaiticg  facilities 
cf  an  irraf^ery  reporting  system  for  the  order  cf  tattle  entry 
portion  of  the  report.  All  keystroke  entries  into  the 
terrrinal  were  copied  by  a  typescript  prograr,  during  the 
experiment  to  provide  a  record  of  the  subject's  performance. 
A  [Tonitor  station  with  a  hardcopy  Computer  Eevices 
hiniterm  and  an  Alanthus  V-203  CRT  display  were  used  to 
record  and  observe  the  subject's  actions,  whether  by  voice 
or  keyboard  entry  (see  Figure  13).  The  Alanthrs  display, 
connected  to  the  T60!2,  provided  the  author  with  a  copy  cf 
the  data  being  displayed  to  the  operator  via  the  Ann  Arbor 
display  used  in  the  tachistoscope  viewport  for  visual 
feedback.  This  was  essential  for  recording,  recognition  and 
rejection  errors  in  the  voice-buffered  mode;  such  errors 
could  not  be  analyzed  fron  the  hardcopy  record  if  edited 
from  the  voice  buffer  prior  to  transmission  of  the  buffer 
contents  to  the  text  editor. 

D.   SUBJECT  PREPARATION 

1.   T6g0  Vocabulary  Training 

Prior  to  the  experiment,  subjects  were  individually 
trained  in  the  use  of  the  T6e0  to  a  level  of  knowledge  and 
competence  to  allow  them  to  operate  it  to  train  the  large 
vocabulary   of   255   words.   Each  subject  was  briefed  on  the 
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proper  training  of  the  Tfci^0,  and  received  a  derronstrat  ion 
and  written  instructions  with  the  training  (see  Appendix  C). 
Cnce  the  subject  had  derronstratea  proficiency  in  operating 
and  training  the  T600,  he/sne  was  alicwed  tc  proceed 
independently,  with  the  author  remaining  nearby  to  answer 
questions  and  correct  training  pitfalls.  Once  training  was 
coinplete,  the  subject  tested  the  vocaoulary  by  saying  each 
word  three  times.  Any  words  which  were  n^isrecognized  or 
rejected  mere  than  cnce  were  retrained  until  a  good  training 
pattern  was  established.  (^:ost  retraining  was  required 
because  the  subject  forgot  hew  the  word  was  prcncunced  v-hen 
initially  trained. 

The  training  was  normally  accorrpl  ished  in  two 
sessions  of  approximately  two  hours  each.  Thus  by  the  time 
the  training  was  complete,  the  subject  was  very  familiar 
with  the  T600.  Approximately  four  hours  was  tne  average 
time  each  subject  spent  with  the  vocabulary  prior  to 
experimentation.  The  training  patterns  were  stored  on  a 
cassette  tape  for  each  subject  and  retained  by  the  author 
until  experimentation. 
c.      Typing  Test 

A  five  minute  typing  test  was  given  to  each  subject 
to  group  the  subjects  into  "FAST"  and  "SLCW"  typing  ability 
groups*  these  groups  were  necessary  for  the  experimental 
design.  The  typing  test  required  only  upper  case  letters 
and  symbols  (Appendix  E) ,  as  did  the  experiment. 
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The  typine'  test  was  administered  and  scored 
sirr.ilarly  to  the  civil  service  test  used  to  screen  clerk- 
typist  applicants  to  determine  their  typing-  ability. 
The  typing  tests  were  scored  for  speed  and  accuracy.  A 
raw  score  in  words  per  minute  was  assigned  according  to 
the  number  of  lines  typed.  Credit  was  given  for  all  lines 
typed,  including  any  portion  of  the  last  line  started. 
The  number  of  words  per  minute  was  based  on  an  average  word 
length  of  five  characters.  For  each  mispelled  word,  0.2 
words  per  minute  were  subtracted  from  the  raw  score, 
thereby  decreasing  the  final  score  to  deduct  for  errors.  lor 
exanple,  if  a  subject  had  a  raw  score  of  40  wpm,  but  made  5 
typing  errors,  the  final   score   would  be  39  wpm. 

Subject  typing  speeds  ranged  uniformly  from  17  to 
58  words  per  minute,  with  an  average  speed  of  43  words  per 
minute.  The  SLOW  typist  scores  ranged  from  17  to  32 
with  an  average  of  25;  JAST  typists  scores  ranged  from  33  to 
58  with  an  average  of  43. 

3.   Subjective  Questionnaire  and  Data  Sheet 

To  assess  the  attitudes  of  each  subject  before  and 
after  experimentation  regarding  their  assessment  of  voice 
data  entry  versus  typed  data  entry,  a  10  item  subjective 
iiuestionnaire  was  developed  (see  Appendix  Z).  The 
questionnaire  asked  for  the  subject's  opinions  regarding  the 
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voice  and  typing  modes  on  concerns  relating  to  usability 
such  as  speed,  accuracy,  flexibility,  training,  and  other 
criteria . 

Subjects  also  completed  a  short  date  sheet  regarding 
age,  previous  job,  background,  next  assignrrent,  and  voice 
experience.   Appendix  F  contains  the  data  sheet  format. 

E.   EXPERIMENTAL  PROCEDURE 

As  soon  as  the  subject  completed  the  vocabulary 
training,  he/she  was  scheduled  to  perform  the  experiment 
which  lasted  between  two  and  four  hours,  depending  on  the 
speed  of  the  subject.  The  experiments  were  conducted  in  the 
NPS  Man-Machine  Lab  at  times  most  convenient  to  the  subject, 
generally  in  the  evening. 

The  subject  was  briefed  concerning  the  general  purpose 
for  the  experiment  and  the  three  major  parts  of  the 
experiment:  typing  mode,  voice-unbuffered  mode,  and  voice- 
buffered  mode  experimental  conditions  (see  Appendix  G). 
Each  experimental  condition  consisted  of  a  practice  card  and 
three  trials.  A  Latin-Square  determined  the  order  of  the 
experimental  conditions  such  that  a  balance  was  maintained 
in  the  numbers  of  people  starting  each  experimental  mode. 
This  balance  was  also  maintained  on  the  second  and  third 
experimental  conditions  for  the  subjects.  In  other  words, 
care   was   taken   that  no  experimental  condition  received  an 
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advantage   fron"   always   being   first,   second,   or   third. 
Subjects  were  assigned  randomly  to  the  crderings. 

The  subject's  task  for  each  aata  entry  mode  was  to  write 
12  simplistic  on-line  imagery  interpretation  reports  cf  the 
USSR/Warsaw  Pact  OB  obtained  from  the  cards  by  looking 
through  the  viewport  of  the  tacnistoscope .  Four  cards  were 
included  per  trial  for  the  three  trials  per  mode. 

Recall  the  sample  cards  in  Figure  le;  they  were  used  for 
typing  (top)  and  voice  (bottom)  modes  respectively,  and 
differed  slightly.  Since  some  utterances  were  actually  two 
or  three  words,  (e.g.  MIG-25  FOXBAT)  and  since  the 
vocabulary  of  equipment  names  were  so  large,  it  was 
unrealistic  to  expect  the  subject  to  recall  which  ones  were 
multiple  words  without  greater  familiarity  with  the 
vocabulary.  A  convention  was  adopted  to  link  such  words 
with  an  underscore  symbol  (_) ,  such  as  riG-25_F0XBAT ,  to 
remind  the  subject  that  tne  name  was  to  be  said  in  a  single 
utterance  vice  two  or  three  utterances.  The  underscore  was 
the  only  distinction  between  the  cards  for  voice  and  typing 
modes . 

The  report  format  is  shown  in  Figure  14.  The  subject 
was  required  to  report  the  installation  number  and  CB 
location  (**)  by  quadrant  in  the  order  shown:  UPPFR  LFFT, 
UPPER  RIGHT,  LOWER  LEFT,  LOWER  RIGHT.  Reports  were  to  be 
separated  by  a  blank  line. 
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INSTALLATION  0298-T14217 

UPPER  LZTT 

27  CONflRhED  ASU-57  AIRBORNE  ASSAULT  GUNS 

UPPER  RIGET 

£0  CONJIRMED  ASU-85  AIRBORNE  ASSAULT  GUNS 

LOWER  LEFT 

20  POSSIBLE  M-20  HEAVY  MORTARS 

48  CONFIRMED  240-MM  BM-24:  ROCKET  LAUNCHERS 

LOWER  RIGHT 

62  PROBABLE  122-MM  D-30  FIELD  HOWITZERS 

INSTALLATION  0199-V14197 

UPPER  LEFT 

11  CONFIRMED  MI-12  HOMER  HELICOPTERS 

t   PROBABLE  MI-6  HOOK  HELICOPTERS 

UPPER  RIGHT 

16  CONFIRMED  MI-4  EOUND  HELICOPTERS 

LOWER  LEFT 

19  PROBABLE  hI-24  HIND  HELICOPTERS 

LOWER  RIGHT 

21  CONFIRMED  MI-10  HARKE  HELICOPTERS 

Figure  14.   OB  Reporting  Format  Based  on  Cards  in  Figure  10 
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Subjects  were  allowed  short  breaks  between  trials  and 
longer  breaks  between  the  entry  modes  as  they  moved  for 
example  fror:  the  typing  portion  to  the  voice-unbuffered 
portion  or  vice-versa. 

The  number  of  characters  per  trial  was  balanced  to  a 
very  high  degree  within  10-lb  characters  and  10-15 
utterances  for  all  modes.  The  average  number  of  keystrokes 
per  trial  for  the  typing  mode  was  1170.  The  average  number 
of  utterances  per  trial  for  the  voice-unbuffered  mode  was 
220/trial,  slightly  less  than  the  228/trial  for  voice- 
buffered.  These  keystrokes  and  utterances  did  not  count  any 
editing  keystrokes  or  utterances,  but  included  all  carriage 
returns  required.  To  perform  the  3  modes  x  3  trials,  a 
minimum  of  approximately  3510  keystrokes  and  1344  utterances 
would  be  required,  plus  any  editing. 

Prior  to  beginning  each  experimental  condition  the 
subject  was  briefed  on  the  entry  mode,  reminded  of  the 
editing  features  available  {delete  character,  delete  word, 
delete  line,  and  repeat  line),  and  allowed  to  practice  the 
entry  mode  by  writing  a  report  for  a  practice  card. 

The  experimenter  monitored  the  entire  experiment  at  the 
station  illustrated  in  Figure  13.  The  elapsed  time  to 
complete  each  trial  was  measured  using  a  digital  stopwatch 
and  recorded.  The  Miniterm  provided  a  typescript  for 
analysis  of  the  reports  for  missing  or  extra  information, 
resulting   from   typing   or  voice  recognition  errors.   Extra 
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typing  keystrokes  or  voice  utterances  used  for  editing  out 
errors  were  noted  for  subsequent  analysis  for  an  efficiency 
reasurement.  The  CRT  display  was  used  for  the  unbuffered 
voice  mode  to  record  the  misrecognitions  and  rejects  since 
they  did  not  appear  on  the  typescript  if  they  were  edited 
prior  to  buffer  transmission. 

At  the  conclusion  of  the  experiment  the  subject 
completed  the  subjective  questionnaire  again.  The  subject 
was  asked  not  to  discuss  the  experiment  with  others. 


F.   DEPENDENT  VARIABLES 

The  following  variables  were  recorded  or   calculated 

per  cent  for  each  trial: 

NCC 

Report  Accuracy  (RA)=   X  100 

NCC   +   OE   +   CE 


where 


NCC:  Number  of  Characters  Correct 
01:  Orriission  Errors/missing  data 
CE:   Commission  Errors/extra  data 


m 


NCK/U 

Mode  Efficiency  (!^E)  =   X  100 

NCK/U  +  EK/U  +  EDK/U 

where     NCK/U:   Number  of  Correct 

Key strokes /Utterances  ( Typing /Voice ) 
EK/U:   Error  Keystrokes/Utterances 
EDK/U:   Editing  Keystrokes/  Utterances 
used  to  recover  errors 
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Reccgniticn    Acciiracy    (RA)    = 


NCR 


X  i?e 


NCR 


NM 


where 


NCR:   Nurr.ber  of  Correct  Recognitions 
NM;   Number  cf  Misrecc^niticns 


Recognition  Accuracy  (RAR)  = 
with  Rejects 


NCR 


NCR   +   NM   +   NR 


X  100 


where 


NCR:   Number  of  Correct  Recognitions 
NM:   Number  cf  Misreccgnitions 
NR:   Number  of  Rejects 


Perhaps  the  most  important  variable  was  the  time  it  took 
for  a  subject  tc  complete  the  trials  in  the  experiment. 
Close  behind  time  is  accuracy,  since  reports  must  be  valid 
in  addition  to  timely.  Thus  it  is  important  to  look  at 
report  output  in  terms  of  accuracy  as  a  system  product. 
Frequently  experimenters  examine  the  errors  made  with  voice 
end  typing  and  report  the  results  as  percentage  of  error. 
However  in  this  experiment  the  final  test  is  in  the  report 
produced  ...  is  it  accurate?  Next,  how  efficient  is  the 
data  entry  mode?  This  is  also  a  useful  statistic  for 
judging  the  merits  of  each  system.  Accuracy  and  efficiency 
were  basic  measures  of  the  total  system  capability,  i.e.  the 
man  end  the  machine.  Recognition  accuracy  was  a  measure  of 
T50e  performance  alone,  with  operator  errors  such  as 
mispronunciation  removed.  Two  recognition  accuracy  measures 
were  examined,  but  the  first  is  considered  most  appropriate 
in  this  experiment  since  the  T600  did  not   output   incorrect 
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data   but    beeped  '  when  it  rejected  what  should  have  been  a 
valid  vocabulary  utterance. 

G.   EYPOTHSSES 

The  following  hypotheses  were  tested: 

1.  Hypotheses  Regarding  Tir^E 

a.  Eo  :   There  is  no  difference  in  TIME  to 

complete  reports  between  FAST 
and  SLOW  typists. 
H|  :   Ho  false. 

b.  Ho  :   There  is  no  difference  in  TIME  to 

complete  reports  among  the 
THPEE  DATA  ENTRY  MODES. 
H|  :  Eo    false. 

c.  Ho  :   There  is  no  difference  in  TIME  to 

complete  reports  among  the 
THREE  TRIALS. 
fi/  :   Ho  false. 

2.  Hypotheses  Regarding  ACCURACY 

a.  Ho  :   There  is  no  difference  in  ACCURACY  of 

reports  between  FAST  and  SLOW  typists. 
E,    :   Ho  false. 

b.  Ho  :   There  is  no  difference  in  ACCURACY  of 

reports  among  the  THREE  DATA  ENTRY  MODES. 
K/  :   Ho  false. 
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c.   Ho  :   There  is  no  difference  in  ACCURACY  cf 
reports  among  the  THREE  TRIALS. 
H;  :   Ho  false. 

3.  Hypotheses  Regarding  EFFICIENCY 

a.  H^  :   There  is  no  difference  in  EFFICIENCY 

between  FAST  and  SLOW  typists. 
H/  :   H^  false. 

b.  H^  :   There  is  no  difference  in  EFFICIENCY 

arrong  the  THREE  DATA  ENTRY  MODES. 
H/  :   Ho  false. 

c.  Eft  :   There  is  no  difference  in  EFFICIENCY 

among  the  THREE  TRIALS. 
E,  ;   Ho  false. 

4.  Hypotheses  Regarding  T6ge  RECOGNITION  ACCURACY 

WITHOUT  REJECTS 

There  is  no  difference  in   RECOGNITION 

ACCURACY  between  FAST  and  SLOW  typists 

Eq   false. 

There  is  no  difference  in   RECOGNITION 

ACCURACY  amon^-  the  TWO  VOICE  MODES. 

Ho  false. 

There  is  no  difference  in   RECOGNITION 

ACCURACY  among  the  THREE  TRIALS. 

Ho  false. 


a. 

Ho 

H| 

b. 

Hd 

H/ 

c. 

E^ 
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5.  Hypotheses  Regarding  1600  RECOGNITION  ACCURACY 

WITH  REJECTS 
a.   Hfl  :   There  is  no  difference  in   RECOGNITION 
ACCURACY  WITH  REJECTS  between  FAST  and 
SLOW  typists. 
El     :   Ho  false. 
D.  Ho    :   There  is  no  difference  in   RECOGNITION 
ACCURACY  WITH  REJECTS  amon^  the  TWO 
VOICE  MODES. 
H;  :   Ho  false, 
c.   H^  :   There  is  no  difference  in   RECOGNITION 
ACCURACY  WITH  REJECTS  arr.ong  the  THREE 
TRIALS. 
fi|  :   Ho  false. 

6.  Hypothesis  Regarding  SUBJECT  ATTITUDES 

Eq    :   There  is  no  difference  in  SUBJECT 

ATTITUDES  regarding  a  preference  for 
VOICE  DATA  ENTRY  over  TYPED  DATA 
ENTRY  after  the  experiment. 

H/  :   H^  false. 

H.   EXPERIMENTAL  DESIGN 

The  conceptual  design  for  the  experiment  is  illustrated 
in  Figure  15,  This  is  a  three-factor  nested  design  with 
repeated  measures  over  trials.  The  suhject  is  nested  within 
only  one  typing  ability  condition.   Recall  that  one-third  of 
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Figure  15.   Conceptual  Design  of  the  Experiment 
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the  subjects  started  typing  first;  another  third  started 
voice-unbuffered  first,  and  another  third  started 
voice-buffered  first. 

An  analysis  cf  variance  procedure  was  selected  to  test 
the  hypotheses  for  reporting  times,  accuracy,  and 
efficiency,  and  T60?  recognition  rates.  A  significance 
level  of  ac  =  3.05  was  used  as  the  experimental  threshold.  A 
sign  test  was  chosen  to  evaluate  the  subjective 
Questionnaire  results  at  a  significance  level  of  ac=  0.10. 

I.   RISULTS 

1 .   Results  for  Reporting  Tine 

The  results  for  reporting  time  were  the  most 
significant,  with  an  analysis  of  variance  (ANOVA)  indicating 
SIGNIFICANT  DIFFIRENCES  in  the  DATA  ENTRY  r^ODES  and  TRIALS 
^p  <  .0005).  The  mean  reporting  times  in  Table  I  show  the 
average  time  in  minutes  to  complete  each  of  the  reporting 
trials  for  each  of  the  three  data  entry  modes.  Table  II 
displays  the  results  of  the  ANOVA  for  reporting  time,  and 
Figures  16  and  17    illustrate  the  significant  differences. 

On  the  average,  voice-unbuffered  was  41%  faster  and 
voice-buffered  was  56%  faster  than  typed  data  entry.  Thus 
voice  lata  entry,  averaging  the  two  modes,  was  50%  faster 
overall  than  typing.  Voice  data  entry  was  faster  because  the 


subject  was  able  tc  simultaneously  receive  information 
through  the  viewport  while  composing  the  report.  The 
feedback  received  on  the  r.onitor  enabled  immediate 
confirmation  of  the  T600  response  to  his/her  utterances. 
The  typist,  in  the  conventional  reporting  mode,  was  forced 
to  return  often  to  the  viewport  to  ^et  additional  items  of 
information,  since  there  was  too  much  to  memorize.  The 
illustrated  differences  may  be  seen  in  Figure  16. 

Learning  over  trials  is  apparent  in  all  three  data 
entry  modes.  Figure  17  illustrates  the  differences  in  time 
to  complete  the  scenario  by  trials.  No  significant 
differences  were  noted  between  typing  abilities.  All 
subjects  adapted  to  the  reporting  task  well.  The  voice- 
buffered  mode  was  the  most  natural  for  subjects  tc  use, 
since  they  could  simply  speak  the  report  into  the  system, 
and  make  corrections  most  easily.  Thus  they  learned  to  use 
it  quickly,  and  improved  slightly  thereafter.  The  voice- 
unbuffered  and  typing  modes,  with  more  room  for  improvement, 
showed  more  learning  as  the  subjects  adapted  to  the 
reporting  scenario. 

No  significant  difference  was  apparent  between  fast 
and  slow  typists  for  this  experirrent.  This  was  primarily 
because  the  amount  of  information  that  the  subject  could  get 
from  the  tachistosccpe  was  limited  to  the  amount  he/she 
could  memorize  when  moving  back  and  forth  to  the  manual 
keyboard. 
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TABLil  I 
MEAN  REPORTING  TIME  (MINUTES) 


VOICE 

VOICE 

TYPING 

UNBUFFERED 

BUFFERED 

FAST  TYPISTS 

Trial  1 

16.2 

11.6 

10.5 

Trial  2 

13. e 

10.5 

10.1 

Trial  3 

13.2 

9.6 

9.1 

All  Trials 

14.3 

10.6 

9.9 

SLOW  TYPISTS 

Trial  1 

1E.0 

12.7 

10.0 

Trial  2 

16.5 

10.6 

9.8 

Trial  3 

15.6 

10.5 

9.2 

All  Trials 

16.7 

11.3 

9.7 

ALL  SUBJECTS 

Trial  1 

17.1 

12.2 

10.3 

Trial  2 

15.1 

10.7 

10.0 

Trial  3 

14.4 

10.1 

9.2 

All  Trials 

15.5 

11.0 

9.8 

For  the  following  analysis  of  variance  several 
abbeviations  are  used  for  the  sake  of  brevity.  Their 
meaning  is  expanded  below: 


SS:  Sum  of  Squares 

df:  degrees  of  freedom 

M'S:  Mean  Sauare 

F:  F  Ratio 

p:  significance  level 
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TABLE    II 
ANALYSIS    CF    VARIANCE   FCR   REPORTING   TI^^E    (SECONDS) 

SOURCE                                SS                  df  MS                      F          p 

BETWEEN    SUBJECTS:    3,568,601.60        19 

TyTDing   Ability           149,472.05           1  149,492.05           0.78      NS 

(TA) 

Error                           3,439,329.61         18  191,073.87 

WITHIN  SUBJECTS:   6,588,601.20   160 

Data    Entry  3,969,141.28  2      1,964,570.64      61.61      «* 

r^cde    (DEM) 

TA    X   DEM                          167,215.63           2  93,607.62        2.91      NS 

Error(l)                     1,159,579.54        36  32,210.54 

Trials  (Tr)       424,868.41    2  212,444.21   33.22   ** 

TA  I  Tr              2766.70    2  1,383.35    0.22   NS 

Error(2)          230,255.50   36  6,395.99 

DEM  I  Tr           66,396.02    4  16,599.01    2.28   NS 

TA  X  DEM  X  Tr       17,872.27     4  4,468.07    0.61   NS 

Error(3)          525,207.79    72  7,294.55 

TOTAL  10,172,124.80   179 

**  F  <  0.0005 
[  NS:  NOT  SIGNIFICANT  for  p  <  0.05  ] 
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2 .   Results  for  Reportine;  Accuracy 

The  results  for  reporting  accuracy  are  shown  in 
Tables  III  and  IV.  The  analysis  cf  variance  for  the 
arcsin-transformed  efficiency  data  revealed  NO  SIGNIFICANT 
DIFFERENCES  in  AIL  CONDITIONS  investigated.  The  subjects, 
whether  fast  or  slow  typists,  did  near  perfect  reporting  in 
each  mode,  over  all  trials.  The  reporting  accuracy  was 
expected  to  be  high,  but  exceeded  the  author's  expectations. 
An  average  of  99.5%  accuracy  was  achieved  for  the 
experiment . 

Subjects  were  told  to  go  as  fast  as  possible,  while 
maintaining  accurate  reporting.  Most  errors  were  errors  of 
omission,  where  a  letter  or  wora  was  missing  from  a  report. 
Even  greater  speeds  could  be  expected,  especially  from 
voice,  in  situations  where  more  errors  could  be  tolerated. 
But  in  the  case  of  imagery  reporting,  accuracy  was  deemed 
essential,  even  though  operationally  reports  are  normally 
edited  before  being  sent  cut  to  the  agencies. 

TABLE  III 
MEAN  REPORTING  ACCURACY  (%) 


VOICE 

VOICE 

TYPING 

UNBUFFERED 

BUFFERED 

FAST  TYPISTS 

99. B 

99.6 

99.7 

SLOW  TYPISTS 

99.2 

99.4 

99.6 

ALL  SUBJECTS 

99.5 

99.5 

99.6 
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TABLE  IV 

ANALYSIS  Of  VARIANCE 

FCR  ARCSIK-TEANSJORMD  REPORTING  ACCURACY 
Y  =  2  '!'  ARCS  IN  [SiiRT(  ACCURACY  %)] 

SOURCE  SS  df        I^S         F    P 

BETWEEN  SUBJECTS:     3.786  19 

Tyring  Ability     0.0k34        1     0.004       0.02   NS 
(TA) 

Error  3.784  18     0.210 

WITHIN  SUBJECTS;     24.030  150 


Data  Entry 
l^ode  (DEM) 

0.346 

2 

0.173 

1.18 

NS 

TA  X  DEM 

0.407 

2 

0.204 

1.40 

NS 

Error(l) 

£.262 

36 

2.146 

Trials  (Tr) 

0.352 

2 

0.176 

1.18 

NS 

TA  X  Tr 

0.202 

2 

0,101 

0.68 

NS 

Error(2  ) 

5.362 

36 

0.149 

DEM  X  Tr 

0.395 

4 

0.099 

0.64 

NS 

TA  X  DEM  X  Tr 

0.326 

4 

0 .  082 

0.53 

NS 

Error (3 ) 

11.078 

72 

0.154 

TOTAL  27.618      179 

[  NS:  NOT  SIGNIFICANT  for  p  <  0.05  ] 
Note:  Arcsin  transform  above  normalizes  the  per  cent  data. 
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3 .   Results  for  Reporting  Efficiency 

The  results  fcr  reporting  efficiency  are  shewn  in 
Tables  V  and  VI.  The  analysis  of  variance  indicated 
SIGNIFICANT  DIFFERENCES  between  the  DATA  ENTRY  MODES. 
Figure  16  shows  the  differences  with  typing  being  the  most 
efficient  at  95%,  voice-buffered  next  with  an  efficiency  of 
S5%,  and  finally  voice-unbuffered  with  an  efficiency  of  80%. 
The  author  attributes  the  efficiency  difference,  in 
part,  to  the  level  of  experience  with  the  mode.  The  reader 
may  recall  that  the  subjects  had,  in  general,  extensive 
keyboard  experience  during  five  quarters  at  NFS.  In 
comparison  with  typing,  the  subjects  had  very  little 
experience  with  voice.  It  is  expected  that  if  subjects  were 
more  skilled  and  efficient  in  the  use  of  voice  data  entry, 
the  time  advantages  reported  earlier  would  be  even  more 
dramatic.  Voice-buffered  was  more  efficient  than  voice- 
unbuffered  because  the  subject  could  edit  out  an  entire 
incorrect  utterance,  vice  deleting  it  by  voice  a  word  at  a 
time  in  the  unbuffered  mode. 
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TABLZ    V 
M2AN    REPORTING    Ei^flCIENCY    {%) 


VOICE 

VOICE 

TYPING 

aNBUFFERED 

BUFFERED 

iAST  TYPISTS 

Trial  1 

93.6 

77.2 

63.5 

Trial  2 

95.1 

60.5 

85.7 

Trial  3 

93.6 

61.6 

83.3 

All  Trials 

94.2 

79.6 

84.2 

SLOW  TYPISTS 

Trial  1 

94.4 

80.0 

66.3 

Trial  2 

95.8 

64.4 

64.4 

Trial  3 

96.7 

76.9 

68.4 

All  Trials 

95.6 

80.4 

86.4 

ALL  SUBJECTS 

Trial  1 

94.0 

78.6 

84.9 

Trial  2 

95.4 

62.5 

85.0 

Trial  3 

95.3 

79.3 

85.8 

All  Trials 

94.9 

80.1 

85.2 
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TABLE  VI 
ANALYSIS  Ot    VARIANCE 
FOR  ARCSIi\-TRAKSFORMED  REPORTING  EFFICIENCY 
Y  =  2  *  ARCSIN  [SQRT(EFFICIENCY  %)] 
SOURCE  SS        df       MS  ?    P 

BETWEEN  SUBJECTS:     3.059        19 

Typing  Ability     0.134        1     0.134       0.62   NS 
(TA) 

Error  2.925       18     0.163 

WITHIN  SUBJECTS:     15.669      16? 


Data  Entry 
Mode  iDi^) 

7.102 

2 

<_-  «  ^  ^  i 

44.95 

#« 

TA  X  DEM 

0.023 

2 

0.011 

0.14 

NS 

Error(l) 

2.S60 

36 

0.079 

Trials  (Tr) 

0.17  0 

2 

0.085 

3.54 

NS 

TA  I  Tr 

0  .020 

2 

0.010 

0.42 

NS 

Srror(2 ) 

0.860 

36 

0.860 

DEM  X  Tr 

0.167 

4 

0.042 

1.40 

NS 

TA  X  DEM  z  Tr 

0.301 

4 

0.075 

2.50 

NS 

Errcr(3) 

2.166 

72 

0.030 

TOTAL  16.746      179 

**  F  <  0.02'1 
[  NS:  NOT  SIGNIFICANT  for  p  <  0.05  ] 
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4.   Results  for  Te00  Recognition  Accuracy 

The  results  fcr  the  Te02  Recognition  Accuracy  are 
shown  in  Tatles  VII,  VIII,  IX,  and  X.  Analysis  of  variance 
cf  the  results  revealed  NO  SIGNIFICANT  CIFFERSNCES  fcr  ALL 
CONDITIONS  considered.  Thus  the  T600  recc^^nized  all 
subjects  equally  well  durins;  all  trials  of  the  experiment. 
The  1602  recognition  accuracy  was  S7.0%  overall  if  an  error 
is  defined  as  a  misrecc^nit ion  only.  If  rejects  are 
included,  the  recognition  accuracy  drops  to  95.5%  as  an 
overall  average. 

These  results  are  hased  on  an  evera,t'e  of  1519 
utterances  per  subject  giving  30,380  utterances  for  the 
entire  experiment  using  20  subjects.  This  number  includes 
the  utterances  required,  plus  misrecogni tions  and  reject 
utterances,  and  finally  the  editing  utterances  used  to 
correct  errors.  A  list  of  rnisreco^nitions  and  rejects  is 
contained  in  Appendix  K. 

The  author  had  expected  the  recognition 
accuracy  to  get  worse  in  later  trials  from  fatigue  or 
frustration,  since  the  experiment  was  two  to  four  hours  in 
length.  One  procedure  that  may  have  helped  was  to 
allow  subjects  to,  upon  their  request,  retrain  troublesome 
words  during  the  course  cf  tne  experiment.  The  tine  to 
retrain  was  counted  against  the  trial  time  to  account  for 
realistic   retraining   that   would  take  place   on  the  job. 
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Table  vii 

man  t6ze  reco^jniticn  accuracy  (%) 

without  rejects 


VOICE 

VOICE 

UN3UFFEREE 

BUFFERED 

FAST  TYPISTS 

97.0 

97.1 

SLOW  TYPISTS 

97,2 

96.9 

ALL  SUBJECTS 

97.0 

97.0 

TABLE  VIII 
MEAN  T600  RECOGNITION  ACCURACY  [%) 
WITH  REJECTS 


VOICE 
UNBUFFERED 

VOICE 

BUFFERED 

FAST  TYPISTS 
SLOW  TYPISTS 

ALL  SUBJECTS 

95.8 
95.2 
95.5 

95.4 
95.4 

95.4 
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TABLE  IX 

ANALYSIS  0?  VAHIANCE 

ARCSIN-TRANSFCRhEL  T6e£  RECOGNITION  ACCURACY 

WITHOUT  REJECTS 

Y  =  2  *  ARCSIN  [SQRT(ACCURACY  %)] 

SOURCE  SS       df        MS         F    P 

BETWEEN  SUBJECTS:     0.864       19 

Typing  Ability     0.001        1     0.001       0.02  NS 
(TA) 

Error  0.963       18     0.046 

WITHIN  SUBJECTS:      1.033      100 


Data  Entry 
Mode  (DEM) 

0.000 

^  1 

0.000 

0.00 

NS 

TA  X  DEM 

0.009 

1 

0.009 

0.69 

NS 

Error(l) 

0.231 

18 

0.013 

Trials  (Tr) 

0.009 

2 

0.005 

0.63 

NS 

TA  X  Tr 

0.037 

2 

0.019 

2.38 

NS 

Error(2) 

0.281 

36 

0.008 

DEM  X  Tr 

0.053 

2 

0.027 

2.45 

NS 

TA  X  DEM  X  Tr 

0.032 

2 

0.016 

1.45 

NS 

Error(3) 

0.3S1 

36 

0.011 

TOTAL  1.897      119 

[  NS:  NOT  SIGNIFICANT  for  p  <  0.05  ] 
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TABLE  X 
ANALYSIS  C?  VARIANCE 

ARCSIN-TRANSFORMEL  RECOGNITION  ACCURACY 

'*ITH  REJECTS 

Y   =    2   *    ARCS  IN    [SgRT (ACCURACY    %)] 

SOURCE  SS  df  l^S 


BETWEEN  SUBJECTS:  0.926  19 

Tyi3in^  Ability  0.000        1     0.000       0.00   NS 
(TA) 

Error  0.926  16     0.051 

WITHIN  SUBJECTS:  1.106  100 


Data  Entry 
Mode  (DEM) 

0.000 

1 

0.000 

0.00 

NS 

TA  X  DEM 

0.004 

1 

0.004 

0.33 

NS 

Error(l) 

0.224: 

18 

0.012 

Trials  (Tr) 

0.001 

2 

0.000 

0.00 

NS 

TA  I  Tr 

0.034 

2 

0.017 

2.43 

NS 

Srrcr(2) 

0.256 

36 

0.007 

DEM  X  Tr 

0.046 

2 

0.023 

1.64 

NS 

TA  X  DEM  X  Tr 

0.018 

2 

0.009 

0.64 

NS 

Error(3) 

0.521 

36 

0.014 

TOTAL  1.977       119 

[  NS:  NOT  SIGNIFICANT  for  p  <  0.05  ] 
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During  the  experirent  the  author  ohserved  that 
subjects  cccasicnally  tecame  frustrated  wnen  the 
T600  was  misreco=;ni  zing  their  utterances.  This 
frustration  appeared  to,  at  tires,  generate  a  lack  of 
confidence  in  the  T6'30,  along  with  a  change  in  the 
overall  pitch,  rate,  and  inflection  of  the  voice. 
The  frustration  seemed  more  prevalent  in  the 
unbuffered  than  the  buffered  mode.  ?or  this  reason,  the 
T600  buffered  mode  was  expected  to  have  a  better 
recognition  rate,  since  it  was  faster  and  somewhat  easier 
to  use.  However  the  results  indicate  there  is  no 
difference  in  the  recognition  rate.  One  explanation  is  that 
subjects  went  faster  in  the  buffered  mode  since  they  could 
correct  the  misrecogni ticns  more  easily.  With  the 
consequence  of  a  misreccgnition  reduced,  they  were  less 
afraid  to  make  mistakes. 

5 .   Results  for  Subject  Attitudes 

The  scores  from  the  subjective  questionnaire  given 
before  and  after  the  experiment  were  tested  for  any  general 
change  in  opinion  regarding  voice  versus  typed  data  entry. 
These  scores  were  evaluated  using  a  two-tailed  nonparamet ric 
sign  test,  ac  =  0.10.  A  significant  snift  in  favcr  of  voice 
data  entry  over  typing  occured  for  half  of  the  criteria 
covered  by  the  questionnaire.  No  significant  shifts  toward 
typing  resulted  from  the  analysis.  Appendix  I  contains  the 
results  of  the  pre/post  questionnaire. 
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Surmariz ine  the  results,  subjects  either  were 
neutral  or  favored  voice  before  and  after  the  experirrent . 
After  the  experiment,  they  preferred  voice  even  more  for 
ease  of  use,  speed,  flexibility,  interrri  ttent  use,  and 
finally  ease  of  learning  to  use  as  en  input  modality.  They 
continued  to  believe  that  voice  was  a  more  accurate, 
sustaining,  relaxed  man-machine  interface  for  on-line 
reporting  of  critical,  tine-sensitive  information  such  as 
intelligence  obtained  in  a  high-pressure  work  environment. 

The  subjects'  positive  attitudes  about  voice  arise 
from  their  fresh  experience  and  observations  of  speech 
recognition  equipment  in  the  C3  Lab  at  NPS,  where  it  is  used 
with  the  wargame  Effectiveness  Simulator  (aES)  with  graphics 
and  other  ARPANET  and  laboratory  facilities  to  demonstrate 
its  potential  for  command,  control,  and  communications 
applications . 
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Ill  .   DISCUSSION 

A.   aENiRAL 

This  thesis  investigated  tne  potential  application  of 
eutonetic  speech  recognition  technology  to  military  imagery 
interpretation  reportinig,  Cnl/  the  order  of  battle  portion 
of  reporting  was  investigated  because  of  limited  time  and 
resources.  The  overall  results  of  the  experiment  are 
supportive  of  the  application  of  voice  data  entry  for 
imagery  interpretation  reporting  systems.  Voice-buffered 
mode  was  58^  faster  than  typing,  while  voice-unbuffered  was 
41%  faster.  On  the  average,  voice  was  50%  faster  than 
typin? . 

Voice  was  faster  because  it  allowed  the  operator  to  view 
the  image  while  reporting.  This  experiment  modeled 
conventional  imagery  reporting  systems  where  a  light  table 
is  located  next  to  a  computer  console.  The  operator 
must  move  back  and  forth  between  the  light  table  and  the 
console,  or  two  operators  work  together,  with  one 
interpreting  the  imagery,  and  the  ether  writing  the  report 
via  the  console.  For  these  situations,  it  appears  voice 
data  entry  world  significantly  improve  reporting  speeds 
and/or  require  only  one  person  per  station  to  perform  the 
task.  For  newer  systems  with  the  keyboard  and  function  keys 
built   into  a  computer  console  with  a  light  table  or  digital 
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disila/,  voice  nay  not  have  as  si.^nificant  an  irrpact  for 
improvinp"  reporting:   speeds. 

Both  voice  and  typing  were  very  accurate  for 
the  experirrental  task,  vith  no  significant  difference 
tetveen  mcies  and  an  overall  accuracy  of  99.5%.  It  is 
interesting  ■  to  note  these  speeds  and  accuracies  were 
obtained  even  though  subjects  were  less  efficient  with 
either  node  of  voice.  Voice-unbuffered  had  &0.1% 
efficiency,  voice-buffered  had  65%  efficiency,  and 
typing  had  95%  efficiency.  These  results  were  all 
attained    at    a  significance  level  of  x  =  ?.05  or  better. 

In  terms  of  recognition  accuracy,  the  results  were 
better  tnan  the  author  expected.  Poorer  results  were 
expected  because  short  phrases  consisting  of  several 
utterances  were  used  rather  than  sirrple  one  or  two  utterance 
commands.  It  was  anticipated  that  subjects  would  run  words 
together  more  than  they  actually  did,  and  it  was  also 
anticipated  that  the  T600  would  have  mere  trouble  with 
similar  sounding  terms  such  as  MICr-25  F0X3AT  and  MIG-25R 
?OXEAT...or  CEARLIZ  I  CLASS  and  CHAHIIZ  II  CLASS.  Though 
the  T6'23  did  nisrecognize  such  words  at  times,  subjects 
quickly  adapted  to  the  situation,  emphasizing  the  portion  of 
the  utterance  that  was  unique,  thereby  achieving 
better  results.  The  97%  overall  recognition  accuracy 
would  likely  improve  with  practice  and  increased  usage. 
Additionally,   new  high-speed    recognition   systems,    like 
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Threshold's  QUIChTAIK  (Trademark),  require  a  much  shorter 
pause  between  utterances,  thus  permitting  the  operator  to 
speak  faster.  CUICKTALK  is  advertised  to  reach  speeds  of 
1S2  words-per-minute ,  and  99^  accuracy  for  rroderately 
trained  speakers.  Vocaoulary  structuring  may  also  be 
performed  which  allows  the  system  to  search  only  a  subset  of 
the  vocabulary,  thus  increasing  the  speed  and  accuracy  of 
recognition.  This  system,  as  advertised,  has  twice  the 
speed  of  the  Te00  used  in  the  experiment. 

Subjects  tendea  to  prefer  voice  before  and  after  the 
experiment  (even  mere).  Jcr  tne  vast  majority  of  subjects, 
this  was  the  first  use  of  voice  continuously  for  an  extended 
period  of  time.  Even  though  it  did  not  meet  some  of  their 
more  lofty  expectations,  they  continued  to  give  voice  the 
edge  in  the  subjective  questionnaire,  and  actually 
strengthed  their  opinions  toward  it  on  several  criteria. 

Thus  this  experiment,  though  outside  an  operational 
setting,  supports  further  research  and  possible  applications 
of  ASR  for  imagery  interpretation  reporting  systems,  and 
perhaps  other  similar  intelligence  and  tactical  co"imend  and 
control  data  systems.  Tne  results  are  certainly  not  new, 
but  add  credence  to  the  related  results  achieved  by  HAIC , 
MPS,  and  others. 

Use  of  the  ARPANET  facilities  in  this 
experiment  demonstrated,  to  a  limited  degree,  that 
reporting   can  be  performed  without   the  benefit   of   a 
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local  host  computer.  This  may  be  very  beneficial  in  the 
future  if  department  of  defease  or^^aniza tions  want  to 
renctely  query  cr  update  a  ccmmcn  data   base. 

E.   RICOrMENDATICNS 
1 .   Research 

The  time  is  perhaps  ripe  for  the  military  to  perform 
sore  research  using  voice  data  entry  as  a  keyboard  assist 
for  one  cr  more  of  the  current  imagery  reporting  systems. 
such  as  TIP!  IIS,  i^AHHZS ,  CATIS,  PACIH,  AIRIS,  and  others. 
Ey  beginning  new  to  look  at  tue  use  of  voice  fcr  these 
systems,  the  intelligence  community  may  be  able  to  identify 
the  specific  questions  needing  to  be  addressed  to  most  fully 
adapt  voice  as  an  input  modality.  In  the  next  five  or  ten 
years,  the  outlook  for  "matter-of-fact"  use  of  voice  is 
good.  By  studying  the  problems  associated  with  training, 
user  acceptance,  physical  interfacing,  vocabulary  size, 
vocabulary  data-base  maintenance,  response  times,  and  other 
areas  now,  voice  will  be  more  easily  applied  later. 

Additionally,  voice  input  may  be  applied  to  other 
tasks  associated  with  the  other  intelligence  disciplines 
using  interactive  computer-controlled  devices.  Corrmand 
center  applications  are  also  receiving  increased  attention 
as  natural  language  query  systems  coupled  with  graphics 
displays  commanded  by  voice  are  now  a  reality  in  terns  of 
advanced  applications  technology. 
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All  new  irr.c^rer/  exploitation  s/sterrs  being  developed 
or  rT'clified  snciiid  fully  consider  the  benefits  of  voice 
recognition  technology.  Considering  the  three  to  eight  years 
it  takes  to  develop  a  new  system,  it  is  highly  likely  that 
hy  the  time  it  is  fielded,  significantly  more  voice 
capabilities  will  be  available.  Special  consideration 
should  be  given  to  not  only  to  how  it  might  aid  interpreters 
in  the  reporting  process,  but  also  how  they  might  be  able  to 
use  it  to  enhance,  nianipulate ,  annotate,  and  otherwise 
modify  digital  softcopy  imagery  on  systems  such  as  Compass 
Preview . 

2  .   Appl icat ions 

Practical  applications  using  voice  data  entry  on  a 
large  scale  will  require  a  significant  amount  of  work.  It 
rust  also  be  proven  that  while  voice  may  be  as  fast  or 
faster  than  typing  that  the  time  differential  achieved 
contributes  commensurately  with  the  additional  cost  of  such 
new  technology.  Careful  attention  must  be  paid  to  involving 
the  users,  since  they  will  ultimately  "sell"  the  system, 
even  though  proven  in  the  lab. 

The  author  recommends  a  small  application  first  with 
a  few  of  the  best  interpreters  who  know  the  imagery 
system  well,  and  are  ambivalent  regarding  voice  c'ata  entry. 
Py  allowing  them  to  use  voice  on  a  daily  basis,  they  can 
develop  the  in-house  expertise  at  the  level  needed  to  apply 
it   on  a  large  scale  later. ..or   they  may  be  able  to  assess 
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that  it  just  won't  work  for  that  particular  application. 

The  Tiilitary  is  fortunate,  having  excellent  research 
people  involved  with  voice  technoloffj.  RACC  and  NPS  are 
just  two  military  institutions  able  to  provide  consultation 
end  assistance. 

C.   CONCLUSIONS 

Since  1972,  autonatic  speech  recognition  has 
proven  to  he  valuable  for  a  nurrber  of  liirited 
applications.  The  future  for  the  technology  is  bright. 
The  author  concludes  voice  is  not  only  feasible,  but 
desirable  as  a  means  toward  the  best  imagery 
interpretation  reporting  possible.  It  is  not  so  much  a 
question  of  whether  voice  can  be  used,  but  rather  ... 
how  can  it  be  used?. ..how  extensively  can  it  be  used?. ..and 
how  cost-effective  will  it  be? 
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AP?Z^DIX  A 

USSR/WARSAW  PACT  ORDER  OF    BATTLE  (OB;  VOCABULARY 

INSTRUCTIONS:  TRAIN  THE  WORDS  IN  THE  GIVEN  SEQUENCE,  USING 
THE  GIVEN  PROMPT.  WORD  NUMPERS  MARKED  >ITH  AN  ASTERISK  XAY 
BE  TRAINED  WITH  THE  GIVEN  PROMPT  OR  YOU  MAY  USE  YOUR  OWN. 
(THESE  WORDS  WILL  BE  USED  EOR  TEXT  EDITING,  AND  THUS  SHOULD 
BE  FAMILIAR,  EASY  TO  REMEMBER)  ***-  BE  SURE  TO  WRITE  IN  THE 
ONE  THAT  YOU  USE  ON  TEE  VOCABULARY  LISTING  SO  THAT  YOU  MAY 
HAVE  IT  FOR  FUTURE  REFERENCE.   ***- 

WORD     PROMPT  OUTPUT 


e 

ZERO 

1 

ONE 

2 

TWO 

3 

THREE 

4 

FOUR 

p 

FIVE 

6 

SIX 

7 

SEVEN 

S 

EIGHT 

9 

NINE 

10 

ALPHA 

11 

BRAVO 

12 

CHARLIE 

13 

DELTA 

14 

ECHO 

15 

FOXTROT 

16 

GOLF 

17 

HOTEL 

18 

INDIA 

19 

JULIET 

20 

KILO 

21 

LIMA 

22 

MIKE 

23 

NOVEMBER 

24 

OSCAR 

25 

POPPA 

26 

QUEBEC 

27 

ROMEO 

28 

SIERRA 

29 

TANGO 

30 

UNIFORM 

31 

VICTOR 

32 

WHISKEY 

33 

XRAY 

0 
1 

2 
3 

4 

K 

6 
7 
8 
9 
A 
B 
C 
D 
E 
F 
G 
H 
I 
J 
K 
L 
M 
N 
0 
P 
0 
R 
S 
T 
U 
V 
¥ 
X 


96 


34 

YANKEZ: 

Y 

35 

ZULU 

Z 

36 

POSSIBLE 

POSSIBLE 

37 

PRC3ABLZ 

PROBABLE 

36 

CONFIRhZD 

_CONfIRMED_ 

39 

DASH 

- 

42* 

ZRASZ 

BKSP  <CTRL  A> 

41 

GO  OR  CARRIAGE  RETURN 

^CARRIAGE  RETURN> 

42 

SLASH 

/ 

43- 

KILL  WORD 

<CTRL  W> 

44- 

KILL  LINE 

^CTRL  X> 

45* 

REPEAT  LINE 

<CTRL  R> 

46 

SPACE 

<SPACE  CHARACTER> 

47 

TEN 

10 

46 

INSTALLATION 

INSTALLATION 

49 

ELEVEN 

11 

50 

UPPER  LEFT 

UPPER  LEFT 

ei 

TANKS 

TANKS 

52 

LIGHT 

LIGHT 

53 

MEDIUM 

MEDIUM 

54 

HEAVY 

HEAVY 

55 

T72 

T-72 

56 

T62 

T-62 

57 

T54/55 

T-54/55 

58 

Tie 

T-10 

59 

T34/65 

T-34/85 

60 

TWELVE 

12 

61 

PT76 

PT-76 

62 

AMPEIBEOUS 

AMPHIBEOUS 

63 

UPPER  RIGHT 

UPPER  RIGHT 

64 

APC 

APC 

65 

ATGW 

ATGW 

66 

ERDM 

BRDM 

67 

BTReePK 

BTR-60PK 

68 

BMP76PB 

BMP-76PB 

69 

BTR152 

BTR-152 

70 

ETR50PK 

BTR-50PK 

71 

EIELD  EWTZRS 

EIELD  HOWITZERS 

72 

ASU65 

ASU-55 

73 

SU100 

SU-100 

74 

AIRBORNE 

AIRBORNE 

75 

LOWER  LEFT 

LOWER  LEET 

76 

D3e 

D-30 

77 

AT3  SAGGER 

AT-3  SAGGER 

78 

ANTI-TK  GUNS 

ANTI-TANK  GUNS 

79 

D74 

D-74 

80 

D20 

D-20 

81 

M1955 

M-1955 

82 

D44 

D-44 

63 

BM21 

BM-21 

54 

M1976 

M-1976 

97 


65 

86 


f?.0&3 


£7 

?R0G4 

86 

FR0G7 

69 

SCUD  A 

90 

SCUD  B 

91 

SS12  SCL3RD 

92 

SSM 

93 

ATI  SNAPPER 

94 

65  MIIIhETiR 

95 

100  MILIMETR 

96 

SA4  GAKZF 

97 

SA6  GAINFUL 

9B 

SA6  GECKO 

99 

SA9  GASKIN 

ize 

LAUNCHERS 

101 

THIRTEEN 

102 

ASW 

103 

FOURTEEN 

104 

AA  GUNS 

105 

FIELD  GUNS 

106 

ZU23/2 

107 

ZSU23/4 

105 

ZSU57/2 

109 

S60 

110 

M44 

111 

M49 

112 

57  MILIMETER 

113 

SU15  FLAGON 

114 

YAK28P  FRBAR 

115 

TU28P  FIDLR 

116 

MIG19  FARMER 

117 

^'IG21  FSHBED 

118 

MIG23  FLGGER 

119 

MIG25  FOXBAT 

120 

MIG27  FLGGER 

121 

TU20  BEAR 

122 

TU126  hOSS 

123 

SU9  FISHPOT 

124 

r^.IG25R  FXBAT 

125 

TU22  BLINDER 

126 

TU16  BADGER 

127 

TU26  BACKFIR 

125 

MI4  EOUND 

129 

MI12  HCMEK 

130 

MI6  HOCK 

131 

MI6  HIP 

132 

MI10  EARKE 

133 

MI24  HIND 

134 

IL36  MAY 

135 

M-4  BISON 

BM-24_ 

FROG-3 

FR0G-4I 

FRCG-7_ 

SCUD-A_ 

SCUD-B_ 

SS-12   SCALEBOARD 

SSM 

AT-1    SNAPPER_ 

65-MM_ 

100-MM_ 

SA-4   GANEF_ 

SA-6   GAINFUL, 

SA-6    GECKO_ 

SA-9    GASKIN_ 

LAUNCHERS 

13 

ASW 

14 

AA    GUNS 

FIELD   GUNS 

ZU-23/2_ 

ZSU-23/4_ 

ZSU-57/2_ 

S-60_ 

M-44_ 

M-49_ 

5  7 -MM 

SU-15   FLAGON 

YAK-28P  FIREBAR_ 

TU-26P  FIDDLER_ 

MIG-19  FARMER, 

MIG-21  FISHBED_ 

MIG-23  FLOGGER_ 

MIG-25  FOXBAT_ 

MIG-27  FLOGGER 

TU-20  3EAR_ 

TU-126  MOSS_ 

SU-9  FISHPOT_ 

MIG-25R    FOXBAT_ 

TU-22    BLINDER 

TU-16    BADGER_ 

TU-26   BACKFIRE, 

MI -4   HOUND_ 

MI-12    HOMER, 

MI -6   HOCK, 

MI-6    KIP, 

MI-10    HARKE, 

M-24    HIND, 

IL-38    MAY, 

M-4    BISON 
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136 

SU19  FENCER 

137 

FIFTEEN 

136 

ANe  CAt^P 

139 

AN  12  CUB 

142 

AN22  COCK 

141 

AK26  CURL 

142 

KA15  HEN 

143 

KA16  HOG 

144 

KA25  HORMONE 

145 

IL12  COACH 

146 

IL14  CRATE 

147 

IL2e  BEAGLE 

148 

IL76  CANDID 

149 

AWACS 

150 

BE12  MAIL 

151 

TRANSPORTS 

152 

FIGHTERS 

153 

BOMBERS 

154 

FIGHTER-BhRS 

155 

STRIKE/ATTCK 

156 

HELICOPTERS 

157 

RECONNAISNC 

156 

SS 

159 

FRIGATE 

i6e 

SSB 

161 

SSGN 

162 

SSEN 

163 

CARRIER 

164 

CRUISERS 

165 

DESTROYERS 

166 

MINESWEEPERS 

167 

FRIGATES 

168 

CORVETTES 

169 

MISSLE 

170 

TORPEDO 

171 

BOATS 

172 

LANDING 

173 

SIXTEEN 

174 

INTELLIGENCE 

175 

SHIPS 

176 

SEVENTEEN 

177 

EIGHTEEN 

178 

KIEV  CLASS 

179 

MOSKVA  CLASS 

180 

SSN 

161 

DELTA  CLASS 

162 

DELTA2  CLASS 

163 

H0TEL2  CLASS 

154 

HOTELS  CLASS 

185 

ASU57 

186 

VICTOR  CLASS 

SU-19  FENCER 

15 

aN-S  CAMP_ 

AN-12  CUB_ 

AN-22  C0CK_ 

AN-2e  CURL_ 

^A-15  HEN_ 

KA-16  EOG_ 

KA-25  KORMCNE_ 

IL-12  CCACH_ 

IL-14  CRATE_ 

IL-26  BEAGLE 

IL-76  CANDID_ 

AWACS 

BE-12  MAIL_ 

TRANSPORTS 

ilGETERS 

BOMBERS 

FIGHTER-BOMBERS 

STRIKE/ATTACK 

HELICOPTERS 

RECONNAISSANCE 

SS 

FRIGATE 

SSB 

SSGN 

SSEN 

CARRIER 

CRUISERS 

DESTROYERS 

MINESWEEPERS 

FRIGATES 

CORVETTES 

MISSLE_ 

TORPEDO_ 

BOATS 

LANDING, 

16 

INTELLIGENCE, 

SHIPS 

17 

16 

KIEV  CLASS_ 

MOSKVA  CLASS_ 

SSN 


DELTA 

DELTA 

HOTEL 

HOTEL 

ASU-57_ 

VICTOR  CLASS 


CLASS_ 

II  CLASS_ 

II  CLASS_ 

III  CLASS 
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187 

YANLIE  CLASS 

166 

GOLIl  CLASS 

1S9 

G0LF2  CLASS 

19  e 

Z'JIU4  CLASS 

191 

KRZSTAl  CLAS 

192 

KHESTA2  CLhS 

193 

MIRKAl  CLASS 

194 

MIRKA2  CLASS 

195 

PZTYAl  CLASS 

196 

PETYA2  CLASS 

197 

JULIET  CLASS 

196 

LOWER  RIGHT 

199 

122  MILIMETR 

200 

FOXTROT  CLAS 

201 

ROMEO  CLASS 

202 

SSG 

203 

SRAVO  CLASS 

204 

ECEOl  CLASS 

205 

ECH02  CLASS 

206 

152  MILIMETR 

207 

TANGO  CLASS 

208 

WHISKEY  CLAS 

209 

CEARLISl  CLS 

210 

CHARLIE2  CLS 

211 

KARA  CLASS 

212 

SVERDLOV  CLS 

213 

KYNDA  CLASS 

214 

KRIVAK  CLASS 

215 

KASHIN  CLASS 

216 

240  MILIMETR 

217 

KANIN  CLASS 

218 

INTERCEPTORS 

219 

KOTLIN  CLASS 

220 

KOTLN  SAM  CL 

221 

SKORY  CLASS 

^-'^  ^\  r> 

RIGA  CLASS 

223 

GRISHA  CLASS 

224 

NANUCHKA  CLS 

225 

POTI  CLASS 

226 

OSAl  CLASS 

227 

0SA2  CLASS 

228 

KOMaR  CLASS 

229 

STENKA  CLASS 

230 

NINETEEN 

231 

TWENTY 

232 

SHERSHSN  CLS 

233 

TWENTY-ONE 

234 

NATYA  CLASS 

235 

YURKA  CLASS 

236 

ALLIGATOR  CL 

237 

POLNOCKY  CLS 

YANKEE  CLASS_ 
GOLF  I  CLASS_ 
GOLF  II  CLASS_ 
ZULQ  IV  CLASS 
KRESTA  I  CLASS_ 
KRESTA  II  CLASS 
hIRKA  I  CLASS_ 
MIRKA  II  CLASS_ 
PETYA  I  CLASS_ 
PETYA  II  CLASS_ 
JULIET  CLASS_ 
LOWER  RIGHT 
12 2 -MM _ 

FOXTROT  CLASS_ 
ROMEO  CLASS_ 
SSG 

BRAVO  CLASS_ 
ECHO  I  CLASS 
ECHO  II  CLASS_ 
152-MM_ 
TANGO  CLASS_ 
WHISKEY  CLASS_ 
CHARLIE  I  CLASS, 
CHARLIE  II  CLASS 
KARA  CLASS_ 
SVERDLOV  CLASS_ 
KYNLA  CLASS, 
KRIVAK  CLASS, 
KASEIN  CLASS_ 
240-MM_ 
KANIN  CLASS_ 
INTERCEPTORS 
KOTLIN  CLASS_ 
KOTLIN-SAM  CLASS 
SKORY  CLASS_ 
RIGA  CLaSS_ 
GRISHA  CLASS_ 
NANUCHKA  CLASS_ 
POTI  CLASS_ 
OSA  I  CLASS_ 
OSA  II  CLASS_ 
KOMAR  CLASS_ 
STENKA  CLASS_ 
19 
20 

SHERSHZN  CLASS_ 
21 

NATYA  CLASS_ 
YURKA  CLASS 
ALLIGATOR  CLASS_ 
POLNCCNY  CLASS 
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236 

T'aENTY-T^aO 

239 

PRIMORYE  CLS 

240 

TWENTY-THEZi 

241 

TWENTY-EOUR 

242 

SS16 

243 

SS20 

244 

SS14  SCFGOAT 

245 

SS15  SCROOGE 

24c 

ICBM 

247 

IRBh 

248 

MOBILE 

2^9 

M240 

250 

MORTARS 

251 

ASSAULT  GUKS 

252 

ROCKET  LCHRS 

253 

AIRCRAFT 

254 

TWENTY-EIVE 

22 

PRIMORYE  CLASS 

23 

24 

ss-ie_ 

SS-22_ 

SS-14  SCAPEGOAT. 

SS-15  SCROOGE_ 

ICBM 

IRBM 

MOBILE, 

M-24e 

MORTARS 

ASSAULT  GUNS 

ROCKET  LAUNCHERS 

AIRCRAFT 

25 


./ 
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APPENDIX    B 
SCENARIO    CARLS 
TYPING    CARDS      ->>>>>>>>    TIRST    T^n/ELVE 


INSTALLATION    0613-T11^14 

I 
I 

**  4  CCNilRMED  3MF-76FB  APC 

7  CONFIR^iED  BREM  APC  -* 

I 

3    CONFIRMED    AT-3    SAGGER   ATG^      ** 

**  4  PROBABLE  ZSU-23/4  AA  GUNS 
I 

40    CCNFIRI^ID   T-54/55    ^:ELIUM    TANKS      ** 

I 

4  PROBABLE  Sii-9  GASKIN  LAUNCHERS 
I 
I 
1 
I 

6  PROBABLE  ZU-23/2  AA  GUNS 
I 


I 

INSTALLATION  eil5-T123l4 

-*  5  CONFIRMED  M-4  BISON  BOMBERS 

**  1  POSSIBLE  TU-20  BEAR  RECONNAISSANCE 

AIRCRAFT         i 

I 
I 

12  CONFIRMED  TU-20  BEAR  BOMBERS  '^"^ 

'!'*  1  CONFIRMED  TU-126  MOSS  AWACS 
i 
I 

2  CONFIRMEE  BE-12  MAIL  RECONNAISSANCE 
AIRCRAFT  i 

7  CONFIRMED  IL-2b  BEAGLE  BOMBERS  ** 

17  CONFIRMED  TU-15  BADGER  BOMBERS   ** 

I 

**  3  PROBABLE  TU-16  BADGER  RECONNAISSANCE 

AIRCRAFT 

I 

I 
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INSTALLATION  ei28-T13213         *- 


/ 


2  CONFIHMID  KRESTA  II  CLASS  CRUISERS 

3  CONFIRMED  KRESTA  I  CLASS  CRUISERS  *= 

I 

""•^  1  POSSIBLE  TANGO  CLASS  SS 

I 
I 
I 

I 

'5^~12"CCNFrRM£D"WEISKEY"CLASS~SS 

2   PROBABLE    CEARLIE    II    CLASS    SSGN      '''* 

I 
I 
I 
I 

1  CONFIRMED  CHARLIE  I  CLASS  SSGN 
*#  j 

I 

I 

I 


INSTALLATION  029e-T142lS 


I  «# 


52    CONFIRMED   ASU-65   AIRBORNE   ASSAULT   GUNS 


27  CONFIRMED  ASU-57  AIRBORNE  ASSAULT  GUNS 

*«  j 

I 
I 
I 
I 
I 

; I 

( 

*-  20  POSSIBLE  M-24:e  HEA^^Y  MORTARS 

I 

62  PROBABLE  122-MM  D-30  FIELD  HOWITZERS  ** 

I 
I 
I 
I 

4:8  CONFIRMED  240-MM  EM-24  ROCKET  LAUNCHERS 

i 
I 

I 

I 

1 
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INSTALLATION  0&27-T21253 

6  CONFIRMED  FOXTROT  CLASS  SS  ** 

12  CONFIRMEL  JULIET  CLASS  SSG 

**  2  PROBABLE  DELTA  II  CLASS  SSBN 

I 
I 


3  PROBABLE  DELTA  CLASS  SSBN 

I 

4~confIrmed~&olf  II~class~ssen"**' 

I 
I 

5  CONIIRMED  POTI  CLASS  CORVETTES 

I 
I 
I 

**  2  POSSIBLE  YANKEe'cLASS  SSBN 

7  PROBABLE  ROMEO  CLASS  SS   ** 

______„_____________ I 

I 


INSTALLATION  0405-T22217 

40  CONFIRMED  T-10  HEAVY  TANKS 


**   57  CCNEIRMED  T-34/8e  MEdUM  TANKS 
**   43  CONFIRMED  T-54/55  MEDIUM  TANKS 


3  CONFIRMED  PT-76  LIGHT  AMPHIBEOUS  TANKS 


*«  I 


**  a  CONFIRMED  BTR-152  APC 


I 


6  CONFIRMED  BRDM  RECONNAISSANCE  APC 
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I 

INSTALLATION  0352-T23224  ** 

I  ■  / 

11  CONnRhEL  TU-22  BLINDER  BOMBERS 

i 
I 
I 

20    CONJIRMED    TU-2e    BACKFIRE   BOMBERS    ** 

5  PROBABLE  IL-2e  BEAGLE  BOMBERS 

j  ** 

I 
1 

i 

**  2  CONFIRMED  IL-76  CANDID  TRANSPORTS 

I 
I 

15  CONFIRMED  AN--12  CUB  TRANSPORTS 

I 

7  CONFIRMED  MI-8  HIP  HELICOPTERS 


.__ I 

INSTALLATION    0247-T24:283 

I 

«*  5  PROBABLE  KOMAR  CLASS  MISSLE  BOATS 

I 
I 

17  CONFIRMED  OSA  I  CLASS  MISSLE  BOATS 

5  CONFIRMED  OSA  II  CLASS  MISSLE  BOATS 
^*  j 

I 

I 
i 

**  7  CONFIRMED  STENKA  CLASS  TORPEDO  BOATS 

I 

I 

**  { 

11  POSSIBLE  NANUCHKA  CLASS  TORPEDO  BOATS 

I 

6  POSSIBLE  GRISHA  CLASS  CORVETTES  ** 

2  PROBABLE  SHERSHEN  CLASS  TORPEDO  BOATS** 

I 

I 
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INSTALLATION  2243-T31£7e 

•»-  V 

12    CONFIRMED   MIS-27    FLCG^JZR    STRIKE/ATTACK 
AIRCRAFT  ! 

16   CONFIRMED   SU-19    FENCER    STRIKE/ATTACK 
AIRCRAFT  1  ** 

2   POSSIBLE   MIG-25R    FOXBAT    RECONNAISSANCE 

AIRCRAFT__** ! 

I 

**  1  CONFIRMED  IL-36  MAY  ASW  AIRCRAFT 
**  { 

3  CONFIRMED  AN-6  CAMP  TRANSPORTS 

i 
I 
I 

t    CONFIRMED  AN-26  CURL  TRANSPORTS 

I 
I 

I 

I 


INSTALLATION    0657-T32179  ** 

!  /       ** 

2  CONFIRMED  HOTEL  II  CLASS  SSBN   / 

1   CONFIRMED   HOTEL    III    CLASS    SSBN 

I 

I 

I 

I 

I 

I 

I 

I 

I 
I 

**   j 

1    PROBABLE   GOLF    I    CLASS    SSB 

**  } 

1    PROBABLE   MIRKA   I    CLASS    LIGHT    FRIGATE 

I 
I 

1  jjssjc 


1    POSSIBLE    ZULU    IV    CLASS    SS 
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INSTALLATION  2.410-T33252 

**  4  CONFIRMED  100-MM  ^-49  AA  GUNS 

4  C0N7IBMZD  2SU-57/2  AA  GUNS  ** 

6  CONFIRMED  65-MM  M-44  AA  GUNS 

#«  j 

/  ! 

6  CGNFIRhZD  FROG-4  SSM  MOEIIE  LAUNCHERS 

I 

I 

1 

6  PROBABLE  AT-1  SNAPPER  ATGW 

1 

I 

*«  j 

4  CONFIRMED  122-MM  D-74  FIELD  GUNS 

I 
I 

21  CONFIRMED  85-MM  D-44  ANTI-TANK  GUNS 

I 

I 


INSTALLATION  0173-T34246     **        ** 
1  CONFIRMEE  TU-126  MOSS  AWACS        / 
1  CONFIRMED  TU-16  BADGER  RECONNAISSANCE 

AIRCRAFT         i 
16  CONFIRMED  AN-22  COCK  TRANSPORTS 

I 
I 
I 
I 

I 

18   CONFIRMED   TU-20   BEAR    BOMBERS 


/ 


«*  j 

I 
I 


12  CONFIRMED  TU-22  BLINDER  BOMBERS  ** 


2  CONFIRMED  TU-20  BEAR  RECONNAISSANCE 
AIRCRAFT  j   ** 


10? 


VOICE-  UNBUfFERED  CARLS   ->  >  >  NEXT  TWELVE 


I 

INSTALLATION  0156-V11L50       *=^ 

I  / 

9    PROBABLE   YAK-28P_EIREBAR    FIGHTER-BOMBERS 

I 

**    12    CONFIRI^SL    SU-15_FLAG0N    INTERCEPTORS 
20    CONFIRMED    TU-2eP_FIDDLER    INTERCEPTORS 

~13~PR0BAELE~MrG-25lf0XBAf~INTERCEPTCRS 

i 
1 
I 
I 
I 

11  POSSIBLE  SU-9_FISEP0T  FIGHTERS  ** 
I 

I 
I 
I 

15  PROBABLE  MIG-21_FISHBED  FIGHTERS** 
I 

I 


INSTALLATION  2357-V12252 


}  «# 


1  CONFIRMED  MOSKVA  CLASS  CARRIER 


I 


1  CONFIRMED  KIEV_CLASS  CARRIER 

I 

**  2  PROBABLE  KARA_CLASS  CRUISERS 

I 

2~P0SSIBLE  VICTOR~CLASS~SSN~^**' 


**  3  CONFIRMED  KASEIN  CLASS  DESTROYERS 


**  4  CONFIRMED  KRIVAK  CLASS  FRIGATES 


I 
I 


6  CONFIRMED  MIRKA  II  CLASS  LIGHT  FRIGATES 
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INSTALLATION  0ie8-Vl3259  ** 

e  PRCEaBLZ  57-MM  S-e^  (^:EDIUM  AA_GUNS 

I 

**   4    CCNFIRf^ED    SA-8_GICK0    LAUNCHERS 

I 
I 
I 

3  CONFIRMED  SA-4:  GANEF  LAUNCHERS  '^'^ 


4  CONFIRMED  SA-6  GAINFUL  LAUNCHERS 


3  CONFIRMED  SS-12  SCALEBGARD  MOBILE  SSM 


*# 


5  CONFIRMED  FROG-3  MOBILE  SSM  -* 


**  4  CONFIRMED  SA-9  GASKIN  LAUNCHERS 

I 


„ I „„ 


INSTALLATION    ei99-V14197 

16  CONFIRMED  MI-4_K0UND  HELICOPTERS 

I 
I 

11  CONFIRMED  MI-12_H0MER  HELICOPTERS 

I 

-*  5  PROBABLE  MI-6  HOOK  HELICOPTERS 


21    CONFIRMiED    MI-10    HARKE    HELICOPTERS 


19  PROBABLE  MI-24  HIND  HELICOPTERS 


_____________^_  I __—_—_ 
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1 I 

!  I 


INSTALLATION  e2e6-V21221 

1  CONFIRMSL  SS-ie  MOBILE  ICEM 

**  1  POSSIBLE  SS-lb_SCRCOGE  MOBILE  IRBM 

*«  1  CONFIRMED  SS-14:_S  CAPEGOAT  MOBILE  IREM 

2    PROBABLE    SS-2e    MOBILE    IRBM   ** 

I 
I 
I 
I 

**  1  CONFIRMED  FROG-7  SSM 

**   3  CONFIRMED  SCUD_A  SSM 
I 
I 
1 
I 


1  POSSIBLE  SCUD  B  SSM 


INSTALLATION  0195-V22231 


10  CONFIRMED  KA-£5_H0RM0NE  HELICOPTERS 

j  «« 

11  CONFIRMED  MI-6  HIP  HELICOPTERS 

T 
I 
I 
I 
I 
I 

**  4  CONFIRMED  KA-15  HEN  HELICOPTERS 

I 

**  6  CONFIRMED  KA-16_H0G  HELICOPTERS 

i 
I 

22  CONFIRMED  IL-12_C0ACH  TRANSPORTS 

1 

22    CONFIRMED    IL-14_CRATE    TRANSPORTS    ** 

I _____________________ 

I 


lie 


INSTALLaTICM    0327-V2324:9 
**   2    PRCBAEIE    PRIMORYE    CLASS    INTILLI&2NCE 


SHIPS  ' 


3    CCNflRl^ED    PCLNCCNY_CLASS    LANDING    SHIPS 
2    CONflRMEC    ALLIGATOR    CLASS    LANDING    SHIPS 


j  «# 


I 
I 

I 
I 


3  CONFIRMED  YURKA  CLASS  MINESWEEPERS 


I 
I 


2  POSSIBLE  NATYA  CLASS  MINESWEEPERS 


4  PROBABLE  PETYA  I  CLASS  FRIGATES 


}  *« 

I 
I 

I „ 

I 


INSTALLATION  0167-V24277 

**  60  CONFIRMED  BTR-e3PK  AMPHIBEOUS  APC 

**  25  CONFIRMED  T-62  MEDIUM  TANKS 
I 

23  CONFIRMED  S5-MM  D-44  ANTI-TANK_GUNS  ** 

I 
I 
{  «# 

18  PROBABLE  BM-21  ROCKET_LAUNCEERS 

. I 

I 
I 
I 

**22  CONFIRMED  122-MM  D-3e  FIELD_HOWITZERS 

j 

*«  j 

19  CONFIRMED  M-1955  FIELD_HOWITZERS 

I 

17  CONFIPMED  M-1976  AIRBORNE  *** 


ASSAULT  GUNS     I 
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INSTALLATION  0528-V31176 


*«  11  CCNFIEI^ED  PETYA  II  CLASS  FRIGATES 


'!'*  2  PROBABLE  BRAVO  CLASS  SS 


I 

I 

**        j 

3  CONFIRMED  ECEO_I_CLASS  SSGN 

I 

~    I 
I 

j  *# 

12    CONFIRr^ED   ECHC_I  I_CLASS    SSGN 

I 
I 

5  CONFIRMED  RIGA_CLASS  FRIGATES 

I 
I 
I 
I 
I 
» 

1 

I 


INSTALLATION  0410-V3223?  ** 

22  CONFIRMEI)  BTR-50PK  AMPHIBEGUS  APC 

I 
I 

4e  CONFIRMEE  T-72  HEAVY  TANKS  —  ** 

IB    PROBABLE    SU-100    ASSAULT_GUNS 

I 

**25  CONFIRMED  152-MM  D-20  FIELD_HOWI TZERS 

1 

^*  j 

24  CONFIRMED  100-hM  h-1955  FIELD_GUNS 

1 

I 

«*  } 

13    PROBABLE   M-1976    AIRBORNE    ASSAULT_GUNS 

I 

I 

1 
I 

I 
I 

I „ 

I 
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INSTALLATION 
15    CONilRMED 

1 

2276-V33264 
^!IG-21    EISHB 

ED 

FIGH' 

rERS 

1 
1 

?;?« 

12    CONflRf'ED    MIG-19    fARriER 

1 
1 

FIGHTER- 

-EOhEE 

**   11    PROBABLE 

MIG- 

1 

-23    ELOGG 

1 
_  1 

ER 

FIGHTERS 

17  CONFIRMED  MIG-27_FL0GGER  STRIKE /ATTACK 
AIRCRAFT         i 

**  { 

21  CONFIRMED  MI&-25  FOXBAT  INTERCEPTORS 

T 
I 

**   } 

3  POSSIBLE  TU-28P  FIDDLER  INTERCEPTORS 


INSTALLATION  0362-V34273 

**    2   PROBABLE   S!CORY_CLASS    DESTROYERS 

I 

**  3  CONFIRMED  KOTLIN_CLASS  DESTROYERS 

i 

2    CONFIRMED   KYNDA_CLASS    CRUISERS    ^'^ 
5    CONFIRMED   KANIN    CLASS    DESTROYERS 

2   CONFIRMED   SVERDLOV_CLASS    DESTROYERS 

«*  { 

I 
I 

**  { 

2  PROBABLE  SHERSEEN_CLASS  TORPEDO  BOATS 

4  CONFIRMED  KOTLIN_S AM_CLASS  DESTROYERS 

_  _  I   _   _ 

_  _  _  I  _ 
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EUi'FEREr-VOICE    CARLS    ->>>>>    NEXT   TWELVE 


INSTALLATION    0613-Vtl£14 

i 

*«  4  CONEIRrED  EMP-76PE  APC 

7  CGNEIRMED  BRDf^  APC  ** 
I 
I 


Z    CCNEIRMID  AT-3_SA0&ZR  AT&W   'i-'* 

**  4  PROVABLE  ZSU-23/4  AA  GUNS 


I . 

40    CONilRr^ED    T-54/5i    KELIUM    TANKS      *- 

I 
I 

4  FR0EA2LS  SA-9_GASKIN  LAUNCHERS 
1     ~ 
I 
I 
1 
j        ^* 

6  PRCBAELE  ZU-23/2  AA_&UNS 

I 

I 


,_ ' 

INSTALLATION  0115-V52314 

*'!'  t    CONFIRMED  M-4_EIS0N  BOMBERS 

**  1  POSSIBLE  TU-Z0_BSAR  RECONNAISSANCE 
AIRCRAFT         I 

12    CONFIRMED    TU-20_BEAR    BOMBERS    ** 

**  1  CONFIRMED  TU-12e_M0SS  AVACS 

I 

«*  j 

2  CONFIRMED  BE-12_MAIL  RECONNAISSANCE 
AIRCRAFT  i 

7  CONFIRMED  IL-28_BEAGLE  BOMBERS  -- 

17  CONFIRMED  TU-16_BADGER  BOMBERS   ** 

I 

**  3  PROBABLE  TU-16  BADGER  RECONNAISSANCE 

AIRCRAFT 

I 

I 
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INSTALLATION  01£6-Vb3cl3         ** 


/ 


2    CONFIRMED    KRESTA_I I_CLASS    CRUISERS 

3    CONHRMEr    KRESTA_I_CLASS    CRUISERS    "^^^ 

I 

'i'-  1  POSSIBLE  TANGO_CLASS  SS 
I 
I 
( 
I 
I 

"^*~12~CCNFrRMED~WHrsZEYlCLASS~SS 

2  PROEAELE  CEARLIE_i I_CLASS  SSGN   -* 

I 
I 
I 
I 
I 

1  CONFIRMED  CHARLIE_I_CLASS  SSGN 

**  { 

I 
I 
I 

I 


__»._  I 

INSTALLATION  0296-V54218 

I 

50  CONFIRMED  ASU-85  AIRBORNE  ASSAULT  GUNS 


{  «* 


27  CONFIRM.ED  ASU-57  AIRBORNE  ASSAULT_GUNS 

*«  [ 

I 
I 
I 
I 

I 
I 

**  20  POSSIBLE  M-242  HEAVY  fORTARS 

62  PROBABLE  122-MM  D-30  FIELD_HOWITZERS  ** 

I 
I 
I 
I 

48  CONFIRMED  240-MM  BM-24  ROCKET_LAUNCHERS 

I 
I 

sK«     j 

I 

~        I 
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INSTALLATION  e&27-V51253 

e  CCNriRMEL  FOXTROT_CLASS  SS  -* 

I    --,  ** 

12  CONFIRMED  JULIIT_CLA£S  SSG 

**  2  PRC5AELE  DELTA.I I_CLASS  SSEN 

i 
I 


3  PROBABLE  DELTA  CLASS  SSEN 


**    j 

I 
I 


4  CONFIRMED  SOLE  II  CLASS  SSEN  '^'^ 


I 
I 


5  CONFIRMED  POTI  CLASS  CORVETTES 


**  2  POSSIBLE  YANKEE  CLASS  SSBN 


7  PROBABLE  ROMEO  CLASS  SS   ** 


INSTALLATION  e405-V62217 

40  CONFIRMED  T-10  HEAVY  TANKS 


**   57  CONFIRMED  T-34/e5  MEDIUM  TANKS 
**   43  CONFIRMEE  T-54/55  MEDIUM  TANKS 


3  CONFIRMED  PT-76  LIGHT  AMPHIBIOUS  TANKS 


««  1 


**  6  CONFIRMED  BTR-152  APC 


I 
I 


6  CONFIRMED  BRDM  RECONNAISSANCE  APC 
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I 

INSTALLATION  0352-V63224  -* 

I  / 

11  CONFIRMZL  TU-22_BLINDER  EOMEERS 

I 
I 
1 

20    CONflRMEL    TU-26_BACKFIRE    BOMBERS    ** 

5  PROBABLE  IL-2e_BEAGLE  BOMBERS-**^' 

I 
I 
I 

I 

**  2  CONFIRMED  IL-76_CANDID  TRANSPORTS 

I 

{   «« 

15  CONFIRMED  AN-12_CUB  TRANSPORTS 

I 
I 

7  CONFIRMED  MI-S_HIP  HELICOPTERS 

I 

I 

1   _ 

.  _      _  _   _    _  _  I  _   _ 


I 

INSTALLATION  0247-V64:2S3 

**  5  PROBABLE  KOMAR_CLASS  MISSLE  BOATS 

I 
I 

17    CONFIRMED   OSA_I_CLASS    MISSLE   BOATS 

I 

5  CONFIRMED  OSA_II_CLASS  MISSLE  BOATS 
«#  j 

I 
I 
I 

**  7  CONFIRMED  STENKA  CLASS  TORPEDO  BOATS 

I 
««  [ 

11  POSSIBLE  NANUCHKA_CLASS  TORPEDO  BOATS 

6  POSSIBLE  GR1SHA_CLASS  CORVETTES  ** 

2  PROBABLE  SHERSHEN_CLASS  TORPEDO  BOATS** 

.___ I 

I 
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I 

INSTALLATION  0243-V71278 
*#  { 

12  CCNFIHhED  MIG-27_f LOGGER  STRIKE/ATTACK 
AIRCRAFT         i 
16  CONFIRMED  SU-19_FENCER  STRIKE/ATTACK 
AIRCRAFT  i         ** 

2  POSSIPLE  I^IG-25R_F0XBAT  RECONNAISSANCE 
AIRCRAFT__** i 

**  1  CONFIRMED  IL-38_MAY  ASW  AIRCRAFT 
*«  { 

3  CONFIR^^ED  AN-B_CAMP  TRANSPORTS 

I 
I 
I 

5  CONFIRMEI)  AN-26_CURL  TRANSPORTS 

{  «« 

I 
I 

1 


INSTALLATION  0657-772179       *=* 

I 

2  CONFIRMED  HOTEL_I I_CLASS  SSBN   / 

1  CONFIRMED  HOTEL  III  CLASS  SSBN 

I 

I 

I 

I 

I 

I 

I 

f 

I 
I 

**   j 

1  PROBABLE  GOLF_I_CLASS  SSB 

** } 

1  PROBABLE  MIRKA_I_CLASS  LIGHT  FRIGATE 

1  POSSIBLE  ZULU  IV  CLASS  SS 

~    1 
I 

I 
I 

I 

I 


/    «* 


lis 


INSTALLATION    0410-V73252 

**   4    CO.NFIRr£D    12Z-^r    M-4:9    AA_GUNS 

4  CONFIRMED    ZSU-57/2    AA_GUNS    -* 

5  CONIIfiMED   Sb-M^*    M-44    AA   GUNS    — ** 


/ 


6    CONFIRMID   FRCG-4   SSM   M05ILZ  LAUNCHERS 

I 

I 

I 

I 

*«  j 

6  PROBABLE  AT-1_SNAPPER  ATGV 

I 
I 

*«  I 

4   CONFIRMED    122-MM   D-74    EIELD_GUNS 

I 
I 

21  CONFIRMED  65-MM  D-44  ANTI-TANK_GUNS 

I 


INSTALLATION    0173-V74246  **  ** 

1    CONFIRMED    TU-126_M0SS    AWACS  / 

1    CONFIRMED    TU-16_BADG2R    RECONNAISSANCE 

AIRCRAFT  I 

16  CONFIRMED  AN-22_CCCK  TRANSPORTS 

*«  ! 


1 

le  CONFIRMED  TU-20  BEAR  BOMBERS 


/ 


*« 


12  CONFIRMED  TU-22  BLINDER  BOMBERS  ** 


I 
2  CONFIRMED  TU-2Z  BEAR  RECONNAISSANCE 


AIRCRAFT 


i   ** 


I 
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APPENDIX  C 
T600  TRAINING  INSTRUCTIONS 
For  this  experirr.ent  a  254  word  vocabulary  will  be  used 
with  the  Threshold  600  (T600;  voice  recosiniticn  system.  You 
will  be  required  to  speaic  each  utterance  ten  times  to  train 
the  T600  to  recognize  your  voice.  Two  sessions  of 
approximately  90  minutes  will  be  req.uired  to  complete  the 
training  prior  to  experimentation. 

Please  observe  the  followini^  guidelines  during  training 
and  operation  of  the  T600,  as  they  will  improve  performance 
and  reduce  the  time  required  for  retraining. 

a.  Use  variety.  Say  the  repetitions  with  the 
variety  of  intonation,  emphasis,  and  volume 
you  would  expect  to  use  in  normal  speech. 

d.  Speak  crisply  without  pausing.  3e  natural 
and  relaxed.  Don't  exaggerate  or 
overemphasize;  for  example  when  saying  the 
word  "five",  don't  say  "FI-I-VEE",  thereby 
overemphasizing  the  end  of  the  word  in  an 
unnatural  way. 
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t.  Do  the  repetiticns  in  groups  to  avoid  treath 
noise  and  help  you  count  the  reps.  For 
example  to  train  tne  word  "zero"  group  the 
zeros  as  follows: 

or 

00e-00e-0000 

rather  than  - 

0000000000 
or 


0  -0  -0  -0  -0  -0  -0  -0  -0  -0 


c.  Adjust  the  microphone  carefully,  as 
demonstrated  {  see  the  picture). 

e.  Leave  a  distinct  pause  between  words.  Ycu 
must  v»ait  for  the  green  RZADY  light  to  come 
on  tefcre  saying  the  next  utterance. 

f.  Use  the  proper  volume.  Watch  the  meter? 
the  needle  should  be  in  the  green  area  or 
just  slightly  in  the  red  on  the  peek  parts 
of  the  word.  Words  trained  in  the  lower 
white  or  upper  red  will  give  poorer  results. 
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Cnce  you  are  corfortable  with  training  the  TfcicZ,  I  will 
ask  you  tc  operate  the  keytoard  for  the  re-nainder  of  the 
training.  I  will  renein  nearby  to  provide  assistance  as 
required.  Ee  sure  to  ask  for  help  if  you  have  any 
questions.  Take  breaks  as  you  need  them;  a  convenient  place 
to  break  is  every  few  pages. 

:}!«>>:  ^s*^*;}:5;«s!tj!;:<t:^s.*s  a!***  *:{:    Operating  the  T600    *>!<5;«5!s*****«**«*5is*5;<«* 

Tc  train  a  word  -       YOU  TYPE        T6e0  RESPONSE 


CTHL-U  WDfF: 

<word    number)        <word   prorrpt> 

.e.g.    0  ZERO 

Now   you   say  the  word  or  phrase  10  times.   Once  the  current 

phrase  disappears  you  are  ready  to  go  onto  the  next  word   of 

the  vocabulary.  Again   you   type  CTRL-U  and  continue  as 
before . 
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APPENDIX  V 
TYPING  TZST 
TEE  SOVIET  NAVAL  AIH  FORCE 

FOR   THE   FIRST   TI(^E   IN   ITS  HISTORY,  THE  SOVIET  NAVAL 
AIR  FORCE  '*ILL  BE  PUTTING  TO  SEA  *ITH  ITS  OWN  AIRCRAFT 
EMBARKED  ON   TEE  FIRST  OF  THE  NEW  SOVIET  AIRCRAFT  CARRIERS, 
THE  KIEV,  WHICH  HAD  ALREADY  BEGUN  ITS  WORKING-UP  TRIALS  IN 
THE   AUTUMN  OF  1974.   DISPLACING  SOME  36,0e0  TONS  WITH  AN 
OVERALL  LENGTH  SLIGHTLY   IN   EXCESS   OF   900   FEET,  THE  KIEV 
IS  PRESUMED  TO  EMBARK   40-50   AIRCRAFT   IN   ALL,   COMPRISING 
A   MIX    OF  HELICOPTERS   AND   FIXED-WING  V/STCL  AIRCRAFT 
(TEE  KIEV  SHOWS  NO  SIGNS  OF   ARRESTER   CABLES   OR   LAUNCH 
CATAPULTS).    THE  SUGGESTED   VERSION   OF  THE  STRIKE  AND 
RECONNAISSANCE  FIGHTER  TO  BE  EMBARKED  ON  THE  KIEV  IS  THE 
YAK-36,  A  VERSION  OF  WHICH  WAS  TESTED  ON  THE  AIRFIELDS  NEAR 
MOSCOW  AND  GIVEN  SEA  TRIALS  ON   THE   SOVIET   HELICOPTER- 
CARRIER   MOSKVA.     THE   YAK-36  UTILIZES   VECTORED   THRUST 
AND   DIRECT  LIFT  IN  COMBINATION.   SUCH  AN  AIR  COMPLEMENT 
MIGHT  BE  BROKEN  DOWN   INTO   30   KA-25  ASW   HELICOPTERS   AND 
15-20  V/STOL  FIXED-WING  AIRCRAFT.   HOW  MANY  OF  THESE 
CARRIERS  WILL  BE  PRODUCED  ? 

AT  LEAST  TWO  0?  THESE  KIEV-CLASS  AIRCRAFT  CARRIERS  ARE 
DUE  TO  ENTER  SERVICE,  WITH  THE  POSSIBILITY  OF  THE  SOVIET 
NAVY  PRODUCING  A  WHOLE  CLASS  OF  SOME  6-6  SHIPS,  THEREBY 
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FACILITATING  CCNTINUCUS  LEPLCYMENT  OF  CNS  VZSSZL  IN  BOTH  TH2 
hSriTSRRANEAM  ANT  THE  INLIAN  OCEAN.   TEE  HELICOPTER 
CGMPLEflENT  PROVIDES  INTENSIVE  AS\v  CAPABILITY  INTO  DISTANT 
SEA  AREAS  (FOR  DEFENSIVE  AND  OFFENSIVE  PURPOSES),  AS  WELL  AS 
FURNISHING  AIRBORNE  TARGET  GUIDANCE  FOR  SURFACE-TO  SURFACE 
ANTISHIP  MISSLES.   THE  V/STOL  AIRCRAFT,  WHILE  PROVIDING  A 
STRIKE  CAPABILITY,  MUST  OBVIOUSLY  INCREASE  THE 
RECONNAISSANCE  COVERAGE  OF  THE  SOVIET  NAVAL  AIR  ARf'  IN  AREAS 
WHICH  ARE  BEYOND  THE  RANGE  OF  EXISTING  LAND-BASED  AIRCRAFT. 
KEANWEILE,  THE  ARMAMENT  OF  TEE  KIEV-GLASS  SHIPS  IS  ITSELF 
SIGNIFICANT.   IT  CONSISTS  OF  A  TWIN  LAUNCHER  FOR  AS* 
MISSLES,  TWO  12-BARRELL  MSU  AS  ROCKET  LAUNCHERS,  TWO  SA-N-3 
SAM  TWIN  LAUNCHERS,  A  NUMBER  OF  RETRACTABLE  SA-N-4  SAM 
LAUNCHERS,  MULTIPLE  57-MM  AAA  MOUNTS  AND  SMALLER  WEAPONS  FOR 
CLOSE-IN  PROTECTION  AGAINST  MISSLES  AND  OTHER  GUIDED 
WEAPONS . 
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APPENDIX  E 
PRE/POST  SUBJECTIVE  CUESTIONN AIRE 
Subjective  Cuesticnnaire         Narre: 


INSTRQCTIONS  :  Express  your  feelings  re^ardin^  typed  data 
entry  and  voice  data  entry.  CIRCLE  TEE  NljrBER  which  BEST 
DESCRIBES  your  opinion  for  each  question. 

1.  Which  data  entry  node  do  you  think  is  the  easiest  to  use 
to  enter  character  strings  and  cornnands? 


Typed 

i/C  t  6 

Entry 


Neutral 


Voice 
Lata 
Entry 


<= 

<= 

<  = 

* 

V 

—  / 

=  > 

=> 

1 

2 

4 

e; 

a. 

7 

2.   Which  data  entry  n^ode  do  you  thinlr  is  the  fastest  mode 
for  entering  character  strings  and  commands? 


Typed 
Lata 
Entry 
\- 

1 


<= 
2 


<= 

3 


Neutral 

* 

4 


=  > 


=> 

6 


Voice 

Lata 

Entry 

=> 


3.   Which  data  entry  mode  is  the  most  accurate  for  entering 
character  strings  and  commands? 


Typed 
Lata 
Entry 
<= 


<= 
2 


<  = 


Neutral 

4 


=  > 


=  > 

6 


Voice 

Lata 

Entry 

=> 
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4.   Which  data  entry  mode  provides  the  most  f lexilji  litv,  in 
general,  for  interaction  with  a  corputer? 


Typed 
Date 
Entry 
<= 


<  = 
2 


Neutral 


<  = 
3 


=  > 


=> 

6 


Voice 

Tata 

Entry 

=> 


t.        «hich  data   entry  rrode  would  you  prefer  to  operate  for 
several  hours,  if  required? 


Typed 

Data 

Entry 


<= 


Neutral 


<  = 


=  > 


=> 


Voice 

Data 

Entry 

=> 


6.   Which  data  entry  -node  would  you  prefer  to  operate  as  a 
more  sporadic  user  of  a  computer  system? 


Typed 
Data 
Entry 
<= 


<= 


<  = 


Neutral 
4 


=  > 


=  > 

6 


Voice 

Data 

Entry 

=> 


7.    Which  data 
operation? 


entry  mode  promotes   the  most   relaxed 


Typed 

Neutral 

Voice 

Data 

Data 

Entry 

Entry 

<= 

<  = 

<  = 

« 

=  > 

=> 

=> 

1 

2 

3 

4 

5 

6 

7 
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Which  data  entry  rrode  woula  "be  the  n-ost  advantageous  to 


use   tc  update  an 
information? 


en -line   data   lase 


i  ntel licence 


Tyred 
La  t  a 
Intry 
<= 


2 


Neutral 

Voice 

Data 
Entry 

« 

=> 

=> 

4 

5 

6 

7 

9.  Which  data  entry  mode  provides  the  best  nan-nechine 
interface  in  a  time-critical,  high-pressure  work 
environment? 


Typed 

Neutral 

Voice 

Data 

Data 

Entry 

Entry 

<= 

<= 

<= 

« 

=  > 

=> 

=> 

1 

2 

3 

4 

5 

6 

7 

10.   Which  data   entry  mode  do  you  think  is  the  easiest  to 
learn? 


Typed 
Data 
Entry 
<= 


<= 
2 


Neutral 


<= 


=> 


Voice 

Data 

Entry 

=> 

=> 

6 

7 

127 


APPENDIX  F 
SUBJECT  DATA  SHEET 


Subject  Data  Sheet 
Name : 


Date: 


Service  : Rank/Grade : ^^ 

Jot/Specialty  Description  (last  job  /  neit  jet) 


Age: 


Prior   to  this  experiment  waat  has  been  your  experience  with 
voice  data  entry  systems  ?   Check  one  or  more. 

a.   I  have  used  a  voice  data  entry  system. 

b.   I  have  seen  a  voice  data  entry  system  demonstrated. 

c.   I  have  studied  \oice  data  entry  systems  (class, 

report ,  thesis ,  etc . ) 

d.   I  have  no  experience  with  voice  data  entry  systems. 


If  you  checked  a.  above,  circle  the  term  that  best  describes 
your  experience  and  skill  with  voice  data  entry. 


:iXT)erience  - 


Skill- 


Considerable 
Modera  te 
Minimal 


High 

Average 

Novice 


Explain : 


If  you  checked  c.  above,  please  briefly  state  the  extent 
of  your  studies. 
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AFPZNDIX  G 
INSTRUCTIONS  BRIZm  TO  SUPJICTS 
TYPING  [^CDE 

1.  During  this  portion  of  the  experiment  ycu  vill  view  12 
cards  and  use  the  ATM  terminal  to  write  a  report  on  each 
card  sirr.ilar  to  the  one  /ou  saw  in  the  sarple  (or  other 
portion  of  the  eiper  irer.t }  .  I  will  step  yen  after  every 
four  cards.  This  will  give  you  a  hreak  and  allow  re  to 
collect  sore  aata. 

2.  Ycu  will  be  usin<?  a  text  editor  at  the  ISIZ  host 
corrruter.  The  edit  keys  discussed  during  training  which  may 
be  used  are  shown  en  the  card  at  the  terminal.  You  may  edit 
errors  only  if  you  are  on  the  line  with  the  error  in  it, 
i.e.  if  you  notice  an  error  en  the  previous  line,  do  not 
attempt  tc  correct  it.  However,  I  will  demonstrate  hew  ycu 
may  void  the  previous  line  if  you  wish  to  do  it  over. 

3.  Pencil  and  paper  are  provided  if  you  want  to  use  them  to 
take  notes  as  ycu  lock  in  the  viewport. 

4.  Now  practice  on  this  card. 

5.  <critique  the  repcrt> 

6.  Ycu  are  to  go  as  fast  as  you  can  while  trying  to 
minimize  errors.  Seep  in  mind  you  are  writing  an 
intelligence  report  which  should  be  timely,  accurate,  and 
complete.   Questions? 

7.  Ck,  start. 

8.  <Trial  #1> 

9.  Ok,  stop.   Rest  a  moment,  then  ycu  will  do  four  more. 
12.   Ck  ,  start . 

11.   <Trial  #2> 
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12.  Ok,  step.   Rest  a  rcment ,  this  is  the  last  set  cf  fcur 
you  will  type  for  the  experiment. 

13.  Ok,    start. 

14.  ^Trial    ff3> 

15.  Stop.   Yon  deserve  a  "break.   Relax  a   while.   You  ray 
=set  up  and  move  arcund,  ^ei    a  drink,  etc. 
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VOICE-UNBUFFERED  hODE 
1.    Turing   this  portion  of  the  experinent  you  will  view  12 


cards , 


ana 


'or  each  card 
part   of   the 
cards.   This 
sone  ia ta . 


use  the 

like 


T6ee  in 
the  one 


unbuffered  rrcde  to  write  a  report 
you  saw  in  the  sample  (or  other 
experiment).  I  will  stop  you  after  every  four 
ill  save  you  a  treak  and  allow  me   to   collect 


2.  The  162i7)  unbuffered  mode  allows  you  to  send  the  output 
corresponding  to  an  utterance  imrrediately  to  the  host 
computer.  So  for  example,  wnen  ycu  say  "CCNFIRK:ED ,"  it  is 
sent  immediately  to  the  computer,  and  in  this  case,  becomes 
a  part  of  the  text  in  tne  text  editor  at  the  ISIE  computer. 
Ycu  may  edit  your  input  as  long  as  ycu  are  on  the  line  that 
has  the  error  using  the  edit  commands  you  trained.  A  list 
of  tne  edit  commands  you  use  is  provided  for  you  here,  along 
with  c  list  of  the  vocabulary  as  reference  material. 

3.  If  ycu  look  in  the  viewport  at  this  time,  you  will  see 
that  the  three  bottom  lines  of  tne  1600  display  may  be  seen. 
These  will  provide  a  visual  feedback  of  the  text  editor 
contents,  and  allow  you  to  view  the  editing  process  as  well 
as  the  card. 

4.  Now  practice  using  the  sample  card  provided. 

5.  <critique  the  report> 

e.   Ycu  are  to   go   as   fast   as  you  can  while  trying  to 

piinimize  errors.   Keep   in  mind  you   are   writing   an 

intelligence  repcrt  which  should  be  timely,  accurate,  and 
complete.   Questions? 

7.   Ck,  start. 

6.  <Trial  #1> 

9.  Ok,  stop.   Rest  a  moment,  then  you  will  do  four  more. 

10.  Ok,  start. 

11.  <Trial  #2> 
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12.  C>,  stop.  Rest  a  Ticment  ,  tnis  will  le  ycur  last  set  cf 
four  to  enter  for  the  unbuffered  mode  pert  of  the 
experirent . 

13  .   Ck,  start . 

14.   <Trial  #3> 


15.   Stop.    You   deserve  a  break.   Relax  a  while.   You  rray 
get  up  and  move  around,  get  a  drink,  etc. 


vcice-3u?jer: 


■  V  i>  Zj 


1.  Turing  this  portion  of  the  experirent 
cards,  and  use  tne  T€00  in  buffered  rrode  tc 
for  each  card  like  the  one  you  saw  in  the 
part  of  the  exper-  inent).  I  will  stop  you 
cards.  This  will  r-jive  ycu  a  break  and  allow 
sone  data . 


you  will  view  12 
write  a  report 
sample  (or  other 
after  every  four 
me   to   collect 


2.    The 
phrases  p 
edit  the 
cr  i ts  e 
errors  ,  t 
"kill   li 
buffer,  y 
trained , 
editor  at 
editing 
buffered 
now  . 


T60e 

ricr  t 
last  u 
quival 
he  ent 
ne."  0 
ou  say 

and 

ISIE. 
featur 
mode. 


buff 
0  sen 
t  tera 
ent  f 
ire  b 
nee  :i 

"go  ' 

the  c 

Eow 

es   0 

I  wi 


erea 
ding 
nee 
cr  7 
uffe 
ou  a 

or 
hara 
ever 
f   t 
11  d 


rode 
them 
in  th 
our  V 
r  nay 
re  re 
"car 
cter 
♦  you 
he  t 
emons 


allows 

tc  tne 
e  buffe 
ocabula 

be   er 
ady  to 
riage 
string 

will  n 
ext  edi 
trate  t 


you  t 
nest 
r  by  s 
ry.   I 
ased 
send  t 
return 
will  b 
ot  be 
tor  at 
he  buf 


0  speak  a  c 
computer, 
aying  "kill 
f  you  n-ake 
with  the 
he  contents 
,"   whichev 
e  sent  tc  t 
£  b 1 e   to  u 
ISIZ  while 
fered  mode 


hain  of 
Ycu  majr 
line  ' 
several 
command 

of  the 
er  you 
he  text 
se   the 

in  the 
for  ycu 


3.  If  you  look  in  the  viewport  at  tnis  tirre,  you  will  see 
that  the  three  bottom  lines  of  tne  T600  display  may  be  seen. 
These  will  provide  a  visual  feedback  of  the  buffer  contents, 
and  allow  you  to  view  the  editing  process  as  well  as  the 
card . 

4.  Now  practice  using  the  sample  card  provided. 

5.  <critique  the  report> 

6.  Ycu  are  to  go  as  fast  as  you  can  while  trying  to 
minimize  errors.  Keep  in  mind  you  are  writing  an 
intelligence  report  which  should  be  timely,  accurate,  and 
complete.   Questions? 

?.   Ok,  start. 

&.   ^Trial  #1> 

9.  Ck,  stop.   Rest  a  moment,  then  you  will  do  four  more. 

10.  Ck,  start. 

11.  <Trial  #2> 


12.  Ck,  stoi.   Rest  a  rcrent,  tnis  will  be  your  last  set  cf 
fcur  tc  enter  fcr  the  "buffered  -^ode  part  of  tne  experinent. 

13 .  Ck,  start .  ' 

14.  <Trial  ff3 . 


15.   Stop.    You   deserve  e  break.   Relax  a 
&et  up  and  n^ove  around,  get   a  drink,  etc. 


while.   You  vr:^:/ 
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APPENDIX    H 

VOCABULAHY   VORES    r^ISRECOGNIZEL   OR    REJECTED 

NOTE:  THE  E0LLCWIK5  LIST  IS  IN  ASCENDING  COLLATING  SEQUENCE 
BY  UTTERANCE  AND  MISRECOGNITON .  THE  MSRECOGN ITIONS  HAVE 
TEE   FOLLOWING    FORMAT: 


A    (B)    X    N 


'A  HERE 


A    =   UTTERANCE    ASSOCIATED    WITH    ie<ZZ 

MISRECOGNITICN 
E    =   SPECIFIC    T6ee   OUTPUT,    IF   DIFFERENT 

THAN  A    above;       E.G."i2)"    MEANS 

THAT  A   NUMERAL    WAS    OUTPUT    RATHER 

THAN  THE    WORD    "TWO" 
N    =   NUMBER   OF    OCCURENCES 

*x*  ^L*  «jt#  «l^  «i«  «i#  ^fr  ^V  V^  ^'^  '^  ^ff  *^*  *ff  V'  *^  *^f  V*  V^  "^  ^^  V^  ^V  V*  V?  ^'^  ^'  M^  *J*  ^*  ^u  Vi^  V*  V'  V' 

*]"*  ^^  ^(»  ^1*  *|»  ^  *i*  ^1^  i^   ^(*  ^t  4|^  »,<«  ffi  *|*  «f«  #(S  ^j^  ffi  ^p  ^1^  ^*  #1*  J^  ^^  #,«  •>!«  *^  *l>.  *(•  ^^  rf^ft  ^1*  *,*  ^f* 

*   UTTERANCE    *  *      MI SRECCGNITION ( S  )    - 

122-MM  100-MM    X    2 

122-MM  152-Mh   X    3 

152-MM  122-MM    X   £ 

85— MM  57— MM 

AA   GUNS  AN-8    CAMP    X    6 

AA   GUNS  ANTI-TANK   GUNS    X   3 

AA  GUNS  YAK-26P   FIREBAR 

AIRCRAFT  ANTI-TANK    GUNS 

AIRCRAFT  CARRIER 

AIRCRAFT  TU-26    BACKFIRE 

AMPHIBIOUS  FRIGATES    X    3 

AN-e    CAMP  AA   GUNS 

ANTI-TANK    GUNS  A^PHIBICUS 

ANTI-TANK   GUNS  AN-8    CAMP    X    4 

ANTI-TANK    GUNS  BEEP*   X    e 

ASSAULT    GUNS  BEEP-    X    16 

ASSAULT    GUNS  MISSILE 

ASU-57  AT-3    SAGGER 

AT-1    SNAPPER  BEEF* 

AT-3   SAGGER  ARC 

BM-21  M-44 

BM-24  BM-21 

EMP-76PB  BTR-6ePK 

BOATS  BEEP* 
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«*«  **«  «'*  Vf  >V  «<«  O^  ^itf  ^i«  %J«  «0  «■«  V' 
1*  •!•  t*  nr  *l*  '<•  *P  *«*  T*  *1*  *T*  -1*  *l* 

-    UTTERAKCZ    - 

^l*  *^    «l#    «*'    V«    ^U    VU    ^li*    v'*  ^l'  W^    *"'  ^^^ 

•r*  1*  n*  *f*  *r"r  n*  n*  1*  •!•  *?  'I"'!* 


■^  ^'^  ^*f  ^V  *V  >^  ^"^  V^  V^  «^  "^  ^^  V'  V^  **^  V^  ^^  V'  >'^  *^  ^^  ^^ 
*|*  >T*  'l^  *»*  ^1|*  1*  *!*  *I*  *!*  *!*  1*  *!■  *!*  •!*  *(*  *!*  ^*  *|*  'I*  *(*  'l*  *|* 

*      MISRICO&NITION(S)    - 

O^  «*«  «i«  OU  0#  v*^  *V  V'  V'  V*  ^'  ^i'  ^'  ^'  ^'  V'  ^i'  ^^  ^^  ^U  •JL*  K^' 

^«  f*  #!;•  '!«  ^^  «|^  ^^  ay*  ^j^  ^«  ^f*  ^|*  #|%  ^>  ^f<  <*f*  ^|«  «f«  ^f«  «|«  ^«  «(< 


CLAS 
CLAS 
CLAS 


30MEEPS 

20rP5RS 

ECMEERS 

BOMBERS 

BRAVO 

BRAVO 

BRAVO 

BRAVO 

BRDh 

BRDM 

ETR-152 

BTR-50PK 

BTR-50PK 

BTR-6ZPE 

CARRIAGE 

CARRIAGE 

CARRIAGE 

CARRIAGE 

CARRIAGE 

CARRIAGE 

CARRIAGE 

CARRIAGE 

CARRIAGE 

CARRIAGE 

CARRIAGE 

CARRIAGE 

CHARLIE    I 

CHARLIE    I 

CHARLIE    I 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 


ETURN 
ETURN 
ETURN 
ElURN 
ETURN 
ETURN 
ETURN 
ETURN 
ETURN 
ETURN 
ETURN 
ETURN 
CLASS 
CLASS 
CLASS 


ALPHA    (Ay 

BEEP*;'    X    7 

IL-14:    CRATE    X    2 

LAUNCHERS 

FRIGATE 

GOLF    I    CLASS 

KOMAR    CLASS    X    2 

KOTLIN    CLASS    X    2 

TORPEDO 

YANKEE 

NINETEEN    (19) 

ETR-6ePK    X    4 

D-20 

BTR-50PK    X    3 

AN-e    CAMP    X    4 

BEEP*   X    2 

BRDM 

CARRIER   X    11 

iRIGATE    X    2 

FRIGATES 

HEAVY    X    3 

SSN 

VICTOR    (V) 

XRAY    (X) 

YAK-2SP    FIREBAR    X 

ZSU-23/4 

FOXTROT    CLASS 

KOTLIN    CLASS 

MIRKA    I    CLASS    X    2 

AIRBORNE 

BEEP*    X    148 

BOMBERS 

BRAVO    (B)    X    4 

BRDM 

ELEVEN    (11)    X   6 

FIVE    (5)    X    7 

FOUR    (4) 

HEAVY    X    4 

KOTLIN    CLASS 

LANDING 

LIMA    (L)    X    5 

MI -4   HOUND    X    5 

MIKE    (M)    X    2 

NINE    (9) 

NOVEMBER    (N)    X   2 

SA-6    GECKO 

SEVEN    (7)    X    2 
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Uu  ^*«  «i^  «''  «t«  V'*  *^  V^  V^  ^^  V'  ^'^  *"'  ^'^  V'  *J^  *^  ^^  ^''  *V  '^t  V'  ^'  ^''  V'  ^'  ^^  ^'  ^'^  V^  "^  V'  ^'  V''  v^ 

^p.  ^|»  *(•  #)■•  *|»  ^^  *|*  ^y*  *|V  ^v  ^|«  ^a-  ^4  ^1*  #|H  #^  *g»  ^f«  ^f«  ^|W  ^|k  ^^  *^   ^j*  >!■»  *(*  ^p  *^«»  ^1^  ^^  s^^  V|»   iifr*  ^«  ^1^ 

-    UTTERANCE    *  *      r^ISRECCGMTICN  ( S  )    ''' 

•>,*  *i*  5|C  3p  *K*  *^*  35*  *\*  o^  'i^  1*  1*  ^1*  *!*  "I*  ^1*  *i*  ^*  ^1*  *!*  ^  1*  'p  •^  ^f'  ^*  'I*  ^1*  ^1*  "^^  l^  ''r*  'i*  ^i*  •t^ 

CONFIRMED  ^       TEN    ( le ) 

CONFIRMED  TWELVE    (12)    X    7 

CONFIRMEE  TWENTY    (23) 

CONEIRMEC  TaENTY-FIVE    (25) 

CONFIRMED  TWENTY-ONE    (21) 

CONFIRMED  UNIFORM    (U) 

CONFIRMED  UPPER   RIGHT 

CONFIRMED  XRAY    (X)    X    6 

CONFIRMED  ZSU-23/4: 

CRUISERS  TWENTY-THREE    (23) 

D-30  D-74 

D-44  TWENTY-FOUR    (24) 

DASH  QUEBEC    (Q) 

DASE  TEN    (10) 

DELETE    LINE  LIMA    (L) 

DELETE   WORD  DELETE    LINE    (CTRL    X) 

DELETE   WORD  TWENTY-THREE    (23) 

DELTA   CLASS  KCTLIN    CLASS    X   2 

DELTA   II    GLASS  GOLF    II    CLASS    X    2 

ECHO    I    CLASS  PETYA    I    CLASS    X    2 

ECHO    II    CLASS  DELTA    II    CLASS    X   2 

ECHO    II    CLASS  PETYA    II    CLASS 

ECEC    II    CLASS  SEERSEEN    CLASS 

EIGHT  AA   GUNS    X   4 

EIGHT  AMPHIBIOUS 

EIGHT  AN-e    CAMP   X   3 

EIGHT  APC 

EIGHT  ASU-eS 

EIGHT  BEEP*   X   4 

EIGHT  EIGHTEEN    (16)    X   4 

EIGHT  FIFTEEN    (15) 

EIGHT  FOUR    (4)    X    5 

EIGHT  HEAVY    X   S 

EIGHT  KA-15    HEN    X    14 

EIGHT  MEDIUM 

EIGHT  SA-a    GECKO 

EIGHT  YANKEE    (Y)    X   7 

ELEVEN  BEEP*   X   6 

ELEVEN  D-20 

ELEVEN  FIVE    (5)    X    2 

ELEVEN  FOUR    (4) 

ELEVEN  ONE    (1)    X   3 

ELEVEN  UPPER   LEFT 

ELEVEN  UPPER   RIGHT 

ERASE  EIGHT    (B) 

FIELD   GUNS  BEEP*   X   2 

FIELD   GUNS  _  JULIETT    X    2 
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^  #  ^  ;;i  ;;t  >):  >;c  jjt  ){:#:;(  >;c  :^ 

*    UTTZRANCI    * 


:^  ;(c  ;4c  9^  :;c  X(  :i<  ^  #  :$(  X«  #  :!<  >i:  ^  »:  »ic  :4c  3$c  :^  >;(  9}: 

*      MISRFCOGNITION(S)    * 

^  ^  3^  ^  ^  »}:  9tc  ^c  :fc  :^  »;:  ^  3;:  :;<  ^  ^  :;c  sji  »;:  ^icjl; :(: 


FIEIE    GUNS 

FIIIL   HOW  IT Z IRS 

FliLD    HOWITZERS 

JIiLD   HOWITZERS 

EIFTIEN 

FIFTEEN 

FIGHTER 

FIGHTER-EOP^BFRS 

FIGHTER-BOr^BERS 

FIGHTER-BOMBERS 

FIVE 

FIVE 

FIVE 

FIVE 

FIVE 

FORTY 

FOUR 

FOUR 

FOUR 

FOUR 

FRIGATE 

FRIGATES 

FRIGATES 

FRIGATES 

FROG-3 

FROG-3 

FROG-4 

GO 

GO 

GO 

GO 

GO 

GO 

GO 

GOLF    I    CLASS 

GRISHA  CLASS 

GRISEA  CLASS 

GRISHA   CLASS 

HEAVY 

HELICOPTERS 

HELICOPTERS 

HELICOPTERS 

HELICOPTERS 

HOTEL    III    CLASS 

IL-14:  CRATE 

INSTALLATION 

INSTALLATION 


T-ie 

BEEP*    X    5 

HELICOPTERS    X   4 

INTELLIGENCE 

EIGHTEEN    (18) 

THIRTEEN    (13)    X    5 

FRIGATES 

ROCKET    LAUNCHERS 

BEEP*  X    3 

TWENTY-ONE  (21) 

AN-e  CAf^P 

BEEP*  X  2 

NINE  (9)  X  2 

PAPA  (P)  X  2 

QUEBEC    (Q)    X   2 

THREE    (3) 

BEEP*   X   33 

FROG-4 

LOWER   RIGHT   X   4 

MOBILE 

IL-38   MAY 

BEEP* 

FRIGATE 

SHERSHEN    CLASS 

BEEP* 

D-20 

PROBABLE 

BEEP*  X  24 

BRAVO    (B)    X   2 

DELTA    (D) 

ECHO    (E)    X   3 

GOLF    (G) 

TWELVE    (12) 

ZERO    (0) 

OSA  I  CLASS 

KYNDA  CLASS 

RIGA  CLASS 

VICTOR   CLASS 

SCUD   B 

BEEP*   X    b 

BRAVO    (B) 

FOXTROT    (F) 

MI-4  HOUND 

HOTEL  II  CLASS  X  3 

MI-24  HIND 

BEEP*  X  3 

S-60 
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*   MISRECOGNITICN (S)  * 


INTELLIGENCE 
INTERCEPTORS 
INTERCEPTORS 
JULIET    CLASS 
KA-16  HOG 
KANIN  CLASS 
KANIN  CLASS 
KANIN  CLASS 
KANIN  CLASS 
KANIN  CLASS 
KANIN  CLASS 
KARA  CLASS 
KARA  CLASS 
KARA   CLASS 
KARA  CLASS 
KARA   CLASS 
KASHIN  CLASS 
KASHIN  CLASS 
KASHIN    CLASS 
KASEIN    CLASS 
KASHIN    CLASS 
KASEIN    CLASS 
KIEV    CLASS 
KIEV    CLASS 
KIEV    CLASS 
KIEV  CLASS 
KIEV    CLASS 
KIEV    CLASS 
KIEV    CLASS 
KILL   LINE 
KILL    LINE 
KILL    LINE 
KILL   LINE 
KILL   LINE 
KILL   LINE 
KILL   VORL 
KILL   WORD 
KILL    WORD 
KILL   WORE 
KCMAR  CLASS 
KOMAR  CLASS 
KOTLIN    CLASS 
KOTLIN    CLASS 
KOTLIN  CLASS 
KOTLIN    CLASS 
KOTLIN  CLASS 
KOTLIN    CLASS 


BEEP*   X    6 
BEEP*  X  3 
HELICOPTERS  X  6 
YURKA  CLASS 
EIGHT  (8) 
CARRIER 

KASHIN    CLASS    X   3 
KIEV  CLASS 
KYNLA   CLASS 
SHERSHEN  CLASS  X  4 
YANKEE  CLASS  X  5 
KANIN  CLASS 
KOMAR    CLASS 
KOTLIN  CLASS  X  3 
STENKA  CLASS 
YURKA   CLASS    X   2 
JULIET    CLASS    X    8 
KANIN  CLASS 
KOTLIN  CLASS 
NATYA   CLASS    X    3 
SHERSEEN    CLASS    X   2 
YANKEE    CLASS 
AIRCRAET 
JULIET    CLASS 
KANIN  CLASS 
KARA  CLASS 
KYNEA  CLASS  X  £ 
SHERSHEN  CLASS 
STENKA  CLASS  X  6 
CHARLIE  [Z]    1   e 
DELETE    (CTRL    X) 
KANIN  CLASS  X  2 
KOTLIN  CLASS 
M-44 

hi -4  HOUND 
BEEP*  X  e 
FIELD   HOWITZERS 
KILL  LINE  X  2 
SEVEN  [7) 
KARA   CLASS    X   2 
MIRKA  I  CLASS 
BRAVO  CLASS 
CHARLIE    II    CLASS 
DELTA   CLASS 
KASHIN    CLASS 
KCMAR  CLASS  X  ? 
MOSKVA  CLASS 
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KOTLIN  CLASS 
KOTLIN  CLASS 
KOTLIN    CLASS 
KHESTA    I    CLASS 
KRESTA  I  CLASS 
KRESTA    I    CLASS 
KRESTA    I    CLASS 
KRESTA  II  CLASS 
KRESTA  II  CLASS 
KRIVAK  CLASS 
KRIVAK  CLASS 
KRIVAK    CLASS 
KRIVAK   CLASS 
KYNTA  CLASS 
KYNDA  CLASS 
KYNDA   CLASS 
KYNLA   CLASS 
LANDING 
LAUNCHERS 
LIGHT 
LIGHT 
LIGHT 
LIGHT 
LIGHT 
LIGHT 

LOWER    LEFT 
LOWER    LEFT 
LOWER   LEET 
LOWER    LEET 
LOWER    LEET 
LOWER   LEFT 
LOWER    LEET 
LOWER   LEFT 
LOWER   LEFT 
LOWER    LEFT 
LOWER   RIGHT 
LOWER   RIGHT 
LOWER   RIGHT 
LOWER    RIGHT 
LOWER   RIGHT 
LOWER    RIGHT 
LOWER    RIGHT 
LOWER   RIGHT 
M-1955 
M— 1955 
M-1955 
M-1976 


POLNCCNY  CLASS 

FOTI  CLASS 

UPPER    LEFT 

CHARLIE  I  CLASS 

ECHO  I  CLASS 

OS  A  I  CLASS  X  4 

RIGA  CLASS 

NANUCEKA  CLASS 

OSA  II  CLASS 

KANIN  CLASS 

KARA  CLASS  X  2 

KOTLIN  CLASS 

KYNDA  CLASS 

KANIN  CLASS  X  8 

NATYA  CLASS 

RIGA  CLASS 

STENKA  CLASS  X  7 

EEEP* 

^:ORTARS  X  6 

BEEP*  X  2 

FIVE  (5) 

LOWER   RIGHT    X    2 

MIKE  (h)  X  4 

ONE  (1) 

TWENTY  (20)  X  3 

BEEP*  X  19 

BTR-52PK 

CORVETTES    X   2 

KOTLIN    CLASS 

LIGHT 

LOWER   RIGHT    X   9 

MOBILE   X   3 

THREE    (3) 

TWENTY-ONE  (21) 

UPPER  LEFT  X  4 

BEEF* 

CONFIRMED 

LIGHT 

LOWER   LEFT 

ONE    (1)    X   3 

SEVEN  (7) 

SEVENTEEN  (17) 

UPPER   RIGHT   X    8 

ASU-85 

BEEP*   X   2 

SU-15    FLAGON 

PT-76 
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*      MISRICOGNITION(S)    - 
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K-242 
M-4    EISON 
^-4    EISON 
r^-4    BISON 
y'-44 
K-49 
1^-49 
rEDIUI^ 
M-ie    HARKE 
^;I-10    HARKE 
MI-12    HOMER 
hIG-19   FAR^^ER 
MIG-21    FISHBEE 
MlG-21    EISEBED 
KIG-23    FICGGER 
riG-25    FOXEAT 
MG-25R    FOXBAT 
MIG-25R    FOXEAT 
MRKA   I    CLASS 
.^IRKA    I    CLASS 
MRKA    II    CLASS 
^'IRKA    II    CLASS 
MIRKA   II    CLASS 
MIRK A    II    CLASS 
MIRKA    II    CLASS 
MISSILE 
MOBILE 
MOBILE 
MOBILE 
MOBILE 
MORTARS 
MOSKVA    CLASS 
MOSKVA   CLASS 
MOSKVA    CLASS 
MOSKVA    CLASS 
NANUCHKA    CLASS 
NANUCEKA   CLASS 
NANUCHKA    CLASS 
NANUCHKA    CLASS 
NANUCEKA    CLASS 
NANUCHKA    CLASS 
NATYA   CLASS 
NATYA   CLASS 
NATYA   CLASS 
NATYA    CLASS 
NATYA   CLASS 
NATYA   CLASS 


EEEP* 

BEEP* 

CHARLIE    I    CLASS 

MI-6    HOOK 

TWENTY-FOUR    (24)    X    3 

M-1955 

TWENTY-FIVE    (25) 

BEEP* 

HI-24   HIND    X    3 

MI-6    EIP 

MlG-19    FARMER 

RIGA    CLASS 

IL-14   CRATE 

MIG-27    FLCGGER 

KA-25    HORMONE 

MIG-25R    FOXEAT    X    2 

KA-25    HORMONE 

MIG-25    FOXBAT    X    3 

ECEC    II    CLASS 

PETYA    I    CLASS 

CHARLIE    II    CLASS    X    2 

TELTA    II    CLASS 

KAN  IN    CLASS 

KOTLIN    CLASS    X    2 

POLNOCNY    CLASS 

TWELVE    (12) 

BEEP*   X    3 

ERAVO    X    2 

HOTEL    (H) 

PROBABLE    X    6 

LAUNCHERS 

BEEP*   X   2 

GOLF    I    CLASS    X    3 

NATYA   CLASS 

PCLNOCNY    CLASS    X    5 

KOTLIN-SAM    CLASS 

KYNEA    CLASS 

SHERSHEN    CLASS 

STENKA    CLASS    X    2 

YANKEE    CLASS 

YURKA   CLASS 

ALLIGATOR   CLASS    X    2 

BEEP* 

KAN  IN    CLASS    X   3 

KASHIN    CLASS    X    2 

KOTLIN    CLASS 

KYNLA    CLASS 
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KATYA  CLASS 

MNI 

NINZ 

MNZ 

MNI 

NINE 

NINI 

NINETEEN 

NINETEEN 

NINETEEN 

ONE 

ONE 

ONE 

ONE 

ONE 

ONE 

ONE 

CSA    I    CLASS 

OSA    II    CLASS 

PETYA    I    CLASS 

PETYA    I    CLASS 

PETYA    II    CLASS 

PETYA  II  CLASS 

PETYA  II  CLASS 

PETYA  II  CLASS 

POLNOCNY  CLASS 

POLNOCNY  CLASS 

POLNOCNY   CLASS 

POLNOCNY  CLASS 

POLNOCNY  CLASS 

POLNOCNY  CLASS 

POLNOCNY  CLASS 

POSSIBLE 

POTI    CLASS 

POTI    CLASS 

POTI    CLASS 

POTI    CLASS 

POTI    CLASS 

FRIMORYE  CLASS 

PRir^ORYE    CLASS 

PRir^ORYE    CLASS 

PROBABLE 

PROBABLE 

PROBABLE 

PROBABLE 

PROBABLE 

PROBALBLE 


POTI    CLASS 

BEEP*   X      2 

FIVE  (5)  X  5 

LIGHT 

Ml-e  HIP 

MIKE  (M) 

TWENTY  (20)  X  6 

EIGHTEEN 

MIKE  (M) 

THIRTEEN    (13) 

BEEP*  X  4 

EIVE  (5)  X  7 

ECUR  (4) 

FOURTEEN  (14)  X  2 

LIGHT  X  2 

M-44 

UPPER  RIGHT 

MIRKA  I  CLASS 

K.RESTA    II    CLASS    X    2 

KANUCHKA  CLASS 

YANKEE  CLASS 

ECHO    II    CLASS 

HOTEL    II    CLASS 

KASHIN  CLASS 

SEERSHEN    CLASS 

ALLIGATOR   CLASS 

BEEP*   X    2 

ECHO    II    CLASS 

HOTEL    II    CLASS 

HOTEL  III  CLASS 

KOTLIN    CLASS 

MOSKVA  CLASS 

BEEP* 

KANIN  CLaSS 

KOTLIN  CLASS  X  3 

MOSKVA  CLASS  X  6 

ROMEO  CLASS 

WHISKEY    CLASS    X    2 

ECHO    I    CLASS 

MIRKA  I  CLASS 

MIRKA  II  CLASS 

BEEP* 

FRAVO  (B)  X  7 

MOBILE  X  3 

POSSIBLE 

TORPEDO 

TWENTY-FOUR    (24) 
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RECONNAISSANCE  B^EF*   X    4 

RECONNAISSANCE  CRUISERS 

RECONNAISSANCE  GRISHA    CLASS 

RECONNAISSANCE  INTELLIGENCE    X    2 

REPEAT    LINE  CARRIAGE    RETURN    I  CTRL    M) 

REPEAT    LINE  D-Z0 

REPEAT    LINE  M-240 

REPEAT    LINE  THREE    [Z] 

RETURN  BEEP*   X    4 

RETURN  CONFIRiYED    X    5 

RETURN  ELEVEN    (li; 

RETURN  SEVEN    (7)    X    2 

RETURN  TEN    (le)    X    2 

RIGA   CLASS  GRISHA   CLASS    X    5 

RIGA   CLASS  VICTOR    CLASS    X   3 

ROMEO    CLASS  POLNOCNY    CLASS 

S-60  SS-16 

S-60  SSG    X    2 

SEVEN  ASSAULT   GUNS 

SEVEN  BEEP*  X   3 

SEVEN  ELEVEN 

SEVEN  EIVE    (5) 

SEVEN  SCUE   A   X    11 

SEVEN  SEVENTEEN    (17) 

SEVEN  SIERA    (S )    X   2 

SEVEN  *EISKEY    CLASS 

SEVEN  ZSU-57/2 

SEVENTEEN  SCUD    A   X   3 

SEERSEEN    CLASS  KANIN    CLASS    X   4 

SHIPS  SIX    (6)    X   2 

SIX  BEEP* 

SIX  DESTROYERS      X    3 

SIX  FRIGATES 

SIX  INDIA    (I) 

SIX  SCUD   B 

SIX  SHIPS    X    9 

SIX  SPACE    (     )    X   20 

SIX  T-72 

SIXTEEN  BEEP'i' 

SIXTEEN  FIFTEEN    (15)    X   4 

SPACE  AI^.PHIBIOUS    X3 

SPACE  BACKSPACE    (CTRL    A) 

SPACE  FRIGATES    X    2 

SPACE  SHIPS 

SPACE  T-10 

SS  SSGN 

SS  SSM 
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SS-14    SCAPEGOAT 

SS-20 

SSB 

SSBN 

SSBN 

SSG 

SSG 

SSGN 

SSGN 

SSGN 

SSGN 

SSGN 

SSM 

SSf^' 

STiNKA   CLASS 

STiNKA   CLASS 

STENKA   CLASS 

STENKA    CLASS 

STENKA   CLASS 

STENKA   CLASS 

STRIKE/ATTACK 

STRIKE/ATTACK 

STRIKE/ATTACK 

SU-15    FLAGON 

SU-19    FENCER 

SU-A9   FISHPOT 

SVERDLOY 

SVERDLOV    CLASS 

SVERDLOV    CLASS 

SVERDLOV    CLASS 

SVERLLOV    CLASS 

T-34/e5 

T-34/55 

T-34/55 

T-34/85 

T-34/S5 

T-54/55 

T-54/55 

T-54/55 

T-54/55 

T-62 

TAMGO 

TANGO   CLASS 

TANKS 

TANKS 

TANKS 


SA-6    GECKO    X    3 

SSP 

SSG    X    6 

SSB    X    5 

SSGN    X    10 

SSB    X    2 

SSGN 

CHARLIE    I    CLASS 

SSBN    X    31 

SSG 

SSM 

SSN    X    4 

SA-6   GAINFUL 

SSN    X    22 

SSM 

JULIET    CLASS 

KANIN    CLASS 

KYNDA    CLASS 

NATYA    CLASS    X    2 

SEERSHEN    CLASS 

VICTOR   CLASS    X    2 

AN -6    CAMP 

BEEP*  X    2 

M-1955 

IL-3&    MAY 

SS-16 

BEEP* 

BEEP* 

OS A    I    CLASS    X    2 

POLNCCNY   CLASS 

STENKA   CLASS    X   2 

YUEKA    II    CLASS 

ASU-85 

M-1955    X    2 

MIG-21    EISHBED 

T-54/55 

TU-26    BACKFIRE   X   3 

BEEP*   X   2 

BMP-76PB 

L-44 

T-34/85    X   20 

TU-16    xiADGER 

NINE    (9) 

NATYA    CLASS 

BEEP* 

BEEP*   X    2 

HEAVY 
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TANKS 

TANKS 

TEN 

TIN 

THIRTEEN 

THREE 

THREE 

THREE 

THREE 

THREE 

THREE 

THREE 

THREE 

THREE 

THREE 

TU-i2    BLINDER 

TU-2e    BEAGLE 

TU-2eP    FIDELER 

TWELVE 

TWELVE 

TWENTY 

TWENTY 

TWENTY 

TWENTY 

TWENTY 

TWENTY 

TWENTY 

TWENTY 

TWENTY-FOUR 

TWENTY-ONE 

TWENTY-ONE 

TWENTY-THREE 

TWENTY-TWO 

LOWER    LEFT 

TWENTY-TWO 

TWO 

TWO 

TWO 

TWO 

TWO 

TWO 

TWO 

TWO 

TWO 

TWO 

TWO 

TWO 


NINETEE 

TWENTY 

BEEP* 

ELEVEN 

FIFTEEN 

CARRIER 

FCURTEE 

FRIGATE 

FROG -3 

HEAVY    X 

hi-e  HI 

THIRTEE 
TWENTY 
TWO    (2) 

WHISKEY 
TU-2e    E 
IL-14:    C 
MIG-23 
BEEP* 
GOLF 
BEEP*   X 
L-30 
FOURTEE 
LIGHT 
I^IKE    (M 
NINETEE 
ONE    (1; 
UPPER   R 
TWENTY- 
BEEP*  X 
TWENTY- 
FROG-3 
BEEP*   X 
LOWER    R 
TWENTY- 
BEEP*   X 
BTR-152 
EIGHT    ( 
FIFTEEN 
FOUR    (4 
FRIGATE 
HEAVY 
LIGHT 
MEDIUM 
T-10 

T-e2 

T-72 


N    (19) 
120) 

(11) 
(15) 

N    (14:)    X    2 
X    8 


P 

N    (13) 

(22) 

IV) 
EAR 

RATE    X    2 
FLCGGER 


4 
N    (14; 


N    (19) 


IGHT 
ONE    (21) 

3 
FOUR    (24)    X    2 


IGHT    X   9 

THREE 
12 

e) 
as) 

)    X    2 


X    4 
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TWO 

TWO 

TWO 

TWC 

TWO 

TWO 

TWO 

UNIIORM 

UPP2R    LEFT 

UPPER    LEFT 

UPPER    LEFT 

UPPER    LEFT 

UPPER   LEFT 

UPPER    LEFT 

UPPER    LEFT 

UPPER   RIGHT 

UPPER   RIGHT 

UPPER    RIGHT 

UPPER   RIGHT 

UPPER   RIGHT 

VICTOR 

VICTOR 

VICTOR 

VICTOR 

VICTOR 

VICTOR 

VICTOR 

VICTOR 

VICTOR 

VICTOR 

VICTOR 

VICTOR 

VICTOR 

VICTOR 

VICTOR 

VICTOR    CLASS 

VICTOR   CLASS 

VICTOR    CLASS 

VICTOR    CLASS 

VICTOR    CLASS 

WHISKEY    CLASS 

YAK-26P    FIREBAR 

YAi-26P   FIREEAR 

YANKEE    CLASS 

YURKA   CLASS 

YURKA   CLASS 

YURKA   CLASS 


TEN    (le)    X    4 

THREE    ^3;    X    e 

TU-22    BLINDER 

TWENTY-TWO    (22)    X    5 

YAK-2SP    FIREBAR 

ZSU-57/2    X    12 

ZU-23/2   X    6 

BRLr 

BEEPi*   X    21 

BRAVO   CLASS    X    3 

EIGHTEEN    (1£; 

ELEVEN    (11) 

KOTLIN    CLASS    X    3 

LOWER    LEFT    X    5 

UPPER    RIGHT    X    ? 

BEEP*  X    6 

LIGHT 

LOWER    LEFT    X   4 

LOWER   RIGHT    X   9 

UPPER    LEFT    X   7 

BEEP*   X    17 

CARRIAGE    RETURN 

CARRIER    X    2 

E— 30 

FIFTEEN    (15)    X   2 

FRIGATE    X    2 

HEAVY 

INDIA    (I)    X    2 

M-1955 

NOVEMBER    (N) 

QUEBEC    (Q)    X   2 

SA-6   GECKO 

THREE    (3)    X   2 

TU-2e   BEAR 

WHISKEY 

BEEP* 

KARA    CLASS 

KYNCA   CLASS    X    2 

MIRKA    II    CLASS 

NANUCHKA    CLASS 

KAN  IN    CLASS 

MIG-19   FARMER 

TU-2eP    FIDDLER 

KAN IN    CLASS    X    4 

KYNDA   CLASS 

PRIMORYF    CLASS 

VICTOR    CLASS    X   3 
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-    UTTERANCE    ^ 

3fC  0^  «y»  #^  «!•  ^«  9g»  4<|C  3^  ^«  3^  3|C  3JC 


#f*  «^  3^  SyC  #f*  3|C  3|*  «|«  3|*  J(«  «(C  3^  ^C  7\*  3|^  «i|C  3^  3JC  ^y*  ^«  #|*>  ^[C 

-      MSRECOGMTION  (S)    '^' 

^c  >;c  ^  sic  ;;c  ^  }{« ;^  ^  >;«  ^  ;jc  ^  :^  3;:  ^  ^  :(C3;i  >}c :!:  ^^ 


ZERO 

ZERC 

ZERO 

ZERC 

ZSU-23/4 

ZSU-57/2 

ZSU-e7/2 

ZSU-57/2 

ZU-23/2 

ZU-23/2 

ZU-23/2 


isACKSPACI    (CTRL   A) 

KILO    iiL)    X    2 

riOBILE 

ZSU-57/2    X    2 

ZU-23/2   X   2 

ASU-57 

ZSU-23/4: 

ZU-23/2 

SU-19    FENCER 

TU-22   BLINDER 

TU-26    BACKFIRE 
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APPENDIX  I 


RESULTS  FOR  PRE/POST  SUBJECTIVE  QUESTIONNAIRE 

The   following  data   reflect  whether   subjects'   attitudes 
shifted  either  toward  typins;  cr  voice  as 


exDeriment . 


A   two-tailed  si^^n  test  was 


a   res' 
used. 


:lt 


the 


Note:  Means 


for  the  pre/post  Biven  below  F.ay  be  n-isleading  if  thought  to 
be  indicative  cf  tne  shift.  Tne  sign  test  looks  at  the  fact 
of  whether  their  was  a  shift  or  not,  and  ignores  the  arount 
of  shift  in  the  analysis,  since  the  amount  ray  be  somewhat 
arbitrary . 

QUESTIONS  and 
PRE  /  POST  MEANS 
for  20  subjects. 


SHIFTS 

SHIFTS 

toward 

toward 

NO 

ac  = .  1  e 

TYPING 

VOICE 

SHIFT 

Signif? 

1.  Which  data  entry  mode 
do  you  think  is  the 
easiest  to  use  to  enter 
character  strings  and 
commands?  (5.1/6.1) 

2.  Which  data  entry  mode 
do  ycu  think  is  the 
fastest  mode  for  entering 
character  strings  and 
commands?  (5,1/5.6; 

3.  Which  data  entry  mode 
is  the  most  accurate  for 
entering 
strings  and 
(4.1/4.8) 


12 


'FS 


character 
commands? 


13 


YES 


NO 


4.  Which  data  entry  mode 
provides  the  most 
flexibility,  in  general, 
for  interaction  with  a 
computer?  (5.1/5.1) 

5.  Which  data  entry  mode 
would   you   prefer   to 
operate    for    several 
hours,  if  required? 
(4.3/4.3) 


12 


VT? 


8 


NO 
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wUESTIONS     and 
PRE  /  POST  KEANS 
for  2e  subjects . 

SHIFTS 
toward 

TYPING 

SEIETS 
toward 
VOICE 

NO 
SHIET 

cx:  =.12 
Signif? 

6.  Which  data  entry  rrode 
would  you  prefer  to 
operate  as  a  rrore 
sporadic  user  of  a 
computer  system? 
(4.3/4.3) 


10 


YES 


7.  Which  data  entry  mode 
promotes  the  most  relaxed 
operation?  (5.0,5.1) 

S.  Which  data  entry  mode 
would  be  the  most 
advantageous  to  use  to 
update  an  on-line  data 
base  of  intelligence 
information?  (5.1/5.0) 


NO 


NO 


9.  Which  data  entry  mode 
provides  the  best 
man-machine  interface  in 
a  time-critical,  high 
pressure  work 

environment?  (5.2/5.0) 


12 


NO 


10.    Which  data   entry 
mode  do  you  think  is   the 
easiest  to  to  learn? 
14.9/5.6) 


13 


YES 
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